00000001:02000400:3.0F:1784043866.505967:0:2962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1784043879.249048:0:3164:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1784043880.879708:0:3225:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 575 MB/s 00000001:01000000:0.0:1784043881.129075:0:3225:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 899 MB/s 00000001:01000000:0.0:1784043881.379070:0:3225:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6351 MB/s 00000020:02000000:0.0:1784043882.104722:0:3257:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_gf04e30c 00000400:02000000:3.0:1784043883.258433:0:3272:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.204.150@tcp [8/256/0/180] 00008000:02000000:0.0:1784043887.218365:0:3422:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1784043949.716357:0:5223:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1784043959.064486:0:5751:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784043959.064492:0:5751:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1784043959.064669:0:5751:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000d870f70d 00000080:02000400:0.0:1784043959.064694:0:5751:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1784043959.069593:0:5751:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1784043959.069605:0:5751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784043959.069697:0:5751:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000bf289651) 00000020:00000080:0.0:1784043959.069715:0:5751:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1784043959.086416:0:5751:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1784043959.089293:0:5751:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1784043959.127605:0:5751:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784043959.127844:0:5751:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784043959.127883:0:5751:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784043959.127941:0:5751:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784043959.128077:0:5751:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784043959.128851:0:5751:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784043959.128860:0:5751:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784043959.129047:0:5751:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a754fd17 00000020:01000004:3.0:1784043959.129056:0:5751:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784043959.129062:0:5751:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784043959.129066:0:5751:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d870f70d from MGS 00000020:01000004:3.0:1784043959.129071:0:5751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784043959.129099:0:5751:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000016efc112) 00000020:00000080:3.0:1784043959.129112:0:5751:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784043959.129184:0:5751:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d870f70d from MGS, refs=2 00080000:01000000:3.0:1784043959.129189:0:5751:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784043959.129195:0:5751:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a754fd25 00000100:00100000:3.0:1784043959.129302:0:5751:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784043959.130173:0:5751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784043959.130178:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784043959.131271:0:5751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784043959.131281:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1784043959.132584:0:5751:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784043959.132856:0:5751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1784043959.132860:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784043959.134078:0:5751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784043959.134087:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784043959.134464:0:5751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1784043959.134470:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784043959.135236:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043959.135240:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043959.135242:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043959.135539:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043959.135542:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043959.135543:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043959.136275:0:5751:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1784043959.140483:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1784043959.386416:0:5751:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2835 MB/s 00000001:01000000:2.0F:1784043959.637161:0:5751:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3055 MB/s 00000001:01000000:2.0:1784043959.887824:0:5751:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 583 MB/s 00000001:01000000:3.0:1784043960.141234:0:5751:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 819 MB/s 00080000:10000000:3.0:1784043960.154693:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1784043960.158313:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1784043960.180117:0:5751:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1784043960.180158:0:5751:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784043960.180161:0:5751:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1784043960.185996:0:5761:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784043960.186095:0:5751:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784043960.186173:0:5751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784043960.186454:0:5751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784043960.186476:0:5751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784043960.187095:0:5751:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784043960.187240:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784043960.187245:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784043960.189637:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784043960.189652:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784043960.190641:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784043960.190652:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1784043960.191602:0:5751:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1784043960.191625:0:5751:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.150@tcp' 00000020:01000004:0.0:1784043960.191628:0:5751:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1784043960.191688:0:5751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.150@tcp (typ=mgc) 00000020:00000080:0.0:1784043960.191712:0:5751:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.150@tcp (0000000050130da1) 00000020:00000080:0.0:1784043960.191730:0:5751:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1784043960.191825:0:5751:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000664940fe@MGC192.168.204.150@tcp: add connection 192.168.204.150@tcp at head 00010000:00010000:0.0:1784043960.192038:0:5751:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.150@tcp-0 is initialized 00000040:01000000:0.0:1784043960.192045:0:5751:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 1 is initialized 10000000:01000000:2.0:1784043960.197167:0:5766:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1784043960.197218:0:5751:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.150@tcp (uuid 712d3e65-f8dc-4c55-81e2-0af9d1e128ec) 00000020:00000080:2.0:1784043960.197241:0:5751:0:(genops.c:1406:class_connect()) connect: client 712d3e65-f8dc-4c55-81e2-0af9d1e128ec, cookie 0x9cc73983a754fd33 00000100:00080000:2.0:1784043960.197253:0:5751:0:(import.c:510:import_select_connection()) MGC192.168.204.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784043960.197258:0:5751:0:(import.c:624:import_select_connection()) MGC192.168.204.150@tcp: import 00000000664940fe using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1784043960.197631:0:5751:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b2868b5e x1870705598660736/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784043960.197656:0:5751:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 712d3e65-f8dc-4c55-81e2-0af9d1e128ec->MGS 00000020:01000004:2.0:1784043960.197674:0:5751:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784043960.197680:0:5751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784043960.198348:0:5751:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e288c821) 00000020:00000080:2.0:1784043960.198369:0:5751:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:3.0:1784043960.198671:0:5765:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1784043960.199780:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b2868b5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3287:1870705598660736:0@lo:250: 00000100:00100000:3.0:1784043960.201952:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043960.202056:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598660736 00000100:00100000:3.0:1784043960.202065:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598660736 00000100:00100000:3.0:1784043960.202094:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784043960.202101:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000772cc46c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3287:x1870705598660736:12345-0@lo:250: 00010000:00080000:3.0:1784043960.202127:0:5762:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 712d3e65-f8dc-4c55-81e2-0af9d1e128ec@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:3.0:1784043960.202154:0:5762:0:(genops.c:1406:class_connect()) connect: client 712d3e65-f8dc-4c55-81e2-0af9d1e128ec, cookie 0x9cc73983a754fd41 00000100:00080000:3.0:1784043960.202289:0:5762:0:(import.c:65:import_set_state_nolock()) 00000000621719e5 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784043960.202343:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000772cc46c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+5:3287:x1870705598660736:12345-0@lo:250: Request processed in 240us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043960.202351:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784043960.202411:0:3287:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1784043960.202419:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.150@tcp: connect to target with instance 0 00000100:00080000:3.0:1784043960.202425:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784043960.202430:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784043960.202442:0:3287:0:(import.c:65:import_set_state_nolock()) 00000000664940fe MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784043960.202445:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784043960.202455:0:3287:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784043960.202459:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b2868b5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3287:1870705598660736:0@lo:250: 00000100:00100000:0.0:1784043960.241624:0:5751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784043960.241834:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1784043960.241847:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1784043960.246615:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784043960.246626:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1784043960.247466:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784043960.247480:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784043960.249474:0:5751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784043960.249664:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784043960.249669:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1784043960.251293:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784043960.251303:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784043960.337084:0:5751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784043960.337266:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784043960.337272:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1784043960.343137:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1784043960.343156:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784043960.345117:0:5751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784043960.345436:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784043960.345443:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784043960.346434:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784043960.346443:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784043960.347301:0:5751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784043960.347608:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784043960.347614:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784043960.352227:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784043960.352246:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784043960.355099:0:5751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784043960.355261:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784043960.355266:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784043960.356059:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784043960.356072:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1784043960.409124:0:5751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784043960.409306:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784043960.409312:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1784043960.412082:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784043960.412099:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784043960.412997:0:5751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784043960.413005:0:5751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784043960.415275:0:5751:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784043960.415299:0:5751:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1784043960.415304:0:5751:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784043960.415436:0:5751:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784043960.415479:0:5751:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1784043960.415483:0:5751:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784043960.415485:0:5751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043960.415486:0:5751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043960.415487:0:5751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043960.415488:0:5751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043960.415490:0:5751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043960.415491:0:5751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043960.415493:0:5751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043960.415494:0:5751:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043960.415495:0:5751:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043960.415497:0:5751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043960.415498:0:5751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784043960.415501:0:5751:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1784043960.415504:0:5751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784043960.415505:0:5751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043960.415506:0:5751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043960.415507:0:5751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043960.415508:0:5751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043960.415509:0:5751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043960.415510:0:5751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043960.415511:0:5751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043960.415511:0:5751:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043960.415512:0:5751:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043960.415513:0:5751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043960.415514:0:5751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784043960.415551:0:5751:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784043960.415570:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598660864:0@lo:253: 00000100:00100000:2.0:1784043960.415644:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043960.415707:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d38900d6 going to sleep for 11 seconds 00000100:00100000:1.0:1784043960.416310:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598660864 00000100:00100000:1.0:1784043960.416319:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598660864 00000100:00100000:1.0:1784043960.416421:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043960.416430:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b697660 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+5:5751:x1870705598660864:12345-0@lo:253: 20000000:01000000:1.0:1784043960.416469:0:5764:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784043960.416471:0:5764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1784043960.416886:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1784043960.417010:0:5764:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1784043960.417285:0:5764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784043960.418521:0:5786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1784043960.419902:0:5764:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784043960.419907:0:5764:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1784043960.419913:0:5764:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1784043960.419916:0:5764:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1784043960.419932:0:5764:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1784043960.420147:0:5764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784043960.420393:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1784043960.420406:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784043960.420449:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1784043960.420505:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1784043960.420561:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1784043960.420646:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1784043960.420654:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1784043960.421154:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1784043960.421164:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1784043960.421264:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1784043960.421273:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1784043960.421321:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1784043960.421375:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1784043960.421415:0:5764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1784043960.421419:0:5764:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1784043960.421432:0:5764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784043960.422612:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1784043960.422631:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784043960.423107:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1784043960.423159:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1784043960.423292:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1784043960.423308:0:5764:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1784043960.423419:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1784043960.423427:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784043960.423474:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1784043960.423518:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1784043960.423569:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1784043960.423580:0:5764:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1784043960.424436:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1784043960.424451:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1784043960.424561:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1784043960.424601:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1784043960.425039:0:5764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1784043960.425111:0:5764:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1784043960.425118:0:5764:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1784043960.425676:0:5787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1784043960.426159:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1784043960.426256:0:5764:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.150@tcp for mdt 20000000:01000000:2.0:1784043960.426259:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:2.0:1784043960.426300:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1784043960.426308:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784043960.426340:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1784043960.426347:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:2.0:1784043960.426412:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1784043960.426423:0:5764:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1784043960.426456:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1784043960.427309:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1784043960.427409:0:5764:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784043960.427413:0:5764:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784043960.427418:0:5764:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1784043960.427424:0:5764:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1784043960.431486:0:5788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1784043960.432747:0:5764:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1784043960.448351:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1784043960.448405:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1784043960.448478:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1784043960.448525:0:5764:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784043960.448539:0:5764:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784043960.448542:0:5764:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784043960.448554:0:5764:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784043960.448557:0:5764:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784043960.448588:0:5764:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784043960.448592:0:5764:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784043960.452103:0:5789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1784043960.452518:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1784043960.452576:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1784043960.452665:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1784043960.452807:0:5764:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784043960.452810:0:5764:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784043960.453473:0:5790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1784043960.453950:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1784043960.453993:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1784043960.454023:0:5764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1784043960.454036:0:5764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784043960.454038:0:5764:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1784043960.454045:0:5764:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784043960.454065:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.454082:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.454091:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.454096:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.454102:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.454107:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.454122:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007530f0cb already unused, calling callback (0000000084d30dcd) 00010000:00010000:2.0:1784043960.454126:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.454133:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.454146:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.454153:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.454158:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007530f0cb/0x9cc73983a754fd48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784043960.454248:0:5764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784043960.700769:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b697660 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+5:5751:x1870705598660864:12345-0@lo:253: Request processed in 284333us (285117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043960.700786:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784043960.700924:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598660864:0@lo:253: 10000000:01000000:2.0:1784043960.701074:0:5751:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784043960.701078:0:5751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784043960.701079:0:5751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043960.701081:0:5751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043960.701082:0:5751:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1784043960.701083:0:5751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043960.701084:0:5751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043960.701086:0:5751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043960.701087:0:5751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043960.701089:0:5751:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784043960.701090:0:5751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043960.701092:0:5751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784043960.701236:0:5751:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d870f70d from lustre-MDT0000 10000000:01000000:3.0:1784043960.701260:0:5751:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784043960.701262:0:5751:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784043960.701267:0:5751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff904bd40e4d40 10000000:01000000:3.0:1784043960.701271:0:5751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784043960.701278:0:5751:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff904bd40e4d40 from 1 10000000:01000000:3.0:1784043960.701281:0:5751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784043960.701338:0:5751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 000000008647e5c6/0x9cc73983a754fd4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043960.701350:0:5751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 000000008647e5c6/0x9cc73983a754fd4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043960.701358:0:5751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 000000008647e5c6/0x9cc73983a754fd4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043960.701377:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009bd96381 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598660992:0@lo:101: 00000100:00100000:3.0:1784043960.701417:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043960.701477:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f4a526a3 going to sleep for 11 seconds 00000100:00100000:0.0:1784043960.701564:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598660992 00000100:00100000:0.0:1784043960.701571:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598660992 00000100:00100000:0.0:1784043960.701623:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784043960.701630:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6ed536e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+5:5751:x1870705598660992:12345-0@lo:101: 00010000:00010000:0.0:1784043960.701644:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043960.701656:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f604b0b3/0x9cc73983a754fd56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fd4f expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043960.701677:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f604b0b3/0x9cc73983a754fd56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fd4f expref: 6 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043960.701685:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f604b0b3/0x9cc73983a754fd56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fd4f expref: 6 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043960.701693:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f604b0b3, rc 0) 00000100:00100000:0.0:1784043960.701730:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6ed536e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+6:5751:x1870705598660992:12345-0@lo:101: Request processed in 101us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043960.701736:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784043960.701861:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009bd96381 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598660992:0@lo:101: 00010000:00010000:2.0:1784043960.701904:0:5751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 000000008647e5c6/0x9cc73983a754fd4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.701913:0:5751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 000000008647e5c6/0x9cc73983a754fd4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043960.702035:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598661120:0@lo:501: 00000100:00100000:2.0:1784043960.702063:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043960.702094:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d38900d6 going to sleep for 11 seconds 00000100:00100000:3.0:1784043960.702154:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598661120 00000100:00100000:3.0:1784043960.702163:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598661120 00000100:00100000:3.0:1784043960.702189:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784043960.702195:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038e4d321 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+6:5751:x1870705598661120:12345-0@lo:501: 00000100:00100000:3.0:1784043960.702404:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038e4d321 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+6:5751:x1870705598661120:12345-0@lo:501: Request processed in 209us (340us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784043960.702411:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784043960.702521:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598661120:0@lo:501: 10000000:01000000:2.0:1784043960.702562:0:5751:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784043960.702578:0:5751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 000000008647e5c6/0x9cc73983a754fd4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.702592:0:5751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 000000008647e5c6/0x9cc73983a754fd4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043960.702601:0:5751:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff904bc9af1000 10000000:01000000:2.0:1784043960.702605:0:5751:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784043960.702609:0:5751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff904bc9af1000 10000000:01000000:2.0:1784043960.702611:0:5751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784043960.702613:0:5751:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff904bc9af1000 from 1 10000000:01000000:2.0:1784043960.702616:0:5751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784043960.702632:0:5751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 000000007530f0cb/0x9cc73983a754fd5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.702638:0:5751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 000000007530f0cb/0x9cc73983a754fd5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.702655:0:5751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 000000007530f0cb/0x9cc73983a754fd5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043960.702666:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598661248:0@lo:101: 00000100:00100000:2.0:1784043960.702689:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043960.702707:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d38900d6 going to sleep for 11 seconds 00000100:00100000:0.0:1784043960.702807:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598661248 00000100:00100000:0.0:1784043960.702811:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598661248 00000100:00100000:0.0:1784043960.702839:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784043960.702845:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d22a909e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+6:5751:x1870705598661248:12345-0@lo:101: 00010000:00010000:0.0:1784043960.702852:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043960.702860:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000327cd27e/0x9cc73983a754fd64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fd5d expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043960.702894:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000327cd27e/0x9cc73983a754fd64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fd5d expref: 7 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043960.702912:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000327cd27e/0x9cc73983a754fd64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fd5d expref: 7 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043960.702920:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000327cd27e, rc 0) 00000100:00100000:0.0:1784043960.702956:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d22a909e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+7:5751:x1870705598661248:12345-0@lo:101: Request processed in 112us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043960.702962:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784043960.703120:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598661248:0@lo:101: 00010000:00010000:2.0:1784043960.703130:0:5751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 000000007530f0cb/0x9cc73983a754fd5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.703137:0:5751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 000000007530f0cb/0x9cc73983a754fd5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043960.703147:0:5751:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784043960.703159:0:5751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 000000007530f0cb/0x9cc73983a754fd5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.703166:0:5751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 000000007530f0cb/0x9cc73983a754fd5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043960.703172:0:5751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784043960.703176:0:5751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784043960.703180:0:5751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff904bc9af1000 10000000:01000000:2.0:1784043960.703182:0:5751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784043960.703184:0:5751:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784043960.703186:0:5751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784043960.703196:0:5751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 000000000ff91b1f/0x9cc73983a754fd6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.703207:0:5751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 000000000ff91b1f/0x9cc73983a754fd6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.703214:0:5751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 000000000ff91b1f/0x9cc73983a754fd6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043960.703224:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598661376:0@lo:101: 00000100:00100000:2.0:1784043960.703246:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043960.703270:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d38900d6 going to sleep for 11 seconds 00000100:00100000:0.0:1784043960.703349:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598661376 00000100:00100000:0.0:1784043960.703353:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598661376 00000100:00100000:0.0:1784043960.703379:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784043960.703386:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acb2c727 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+7:5751:x1870705598661376:12345-0@lo:101: 00010000:00010000:0.0:1784043960.703393:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043960.703400:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b0b7c39/0x9cc73983a754fd72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fd6b expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043960.703413:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b0b7c39/0x9cc73983a754fd72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fd6b expref: 8 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043960.703420:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b0b7c39/0x9cc73983a754fd72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fd6b expref: 8 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043960.703426:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b0b7c39, rc 0) 00000100:00100000:0.0:1784043960.703459:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acb2c727 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+8:5751:x1870705598661376:12345-0@lo:101: Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043960.703466:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784043960.703579:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598661376:0@lo:101: 00010000:00010000:2.0:1784043960.703601:0:5751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 000000000ff91b1f/0x9cc73983a754fd6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043960.703608:0:5751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 000000000ff91b1f/0x9cc73983a754fd6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043960.703648:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598661504:0@lo:501: 00000100:00100000:2.0:1784043960.703671:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043960.703690:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d38900d6 going to sleep for 11 seconds 00000100:00100000:3.0:1784043960.703794:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598661504 00000100:00100000:3.0:1784043960.703798:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598661504 00000100:00100000:3.0:1784043960.703829:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784043960.703835:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031cd3e4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+8:5751:x1870705598661504:12345-0@lo:501: 00000100:00100000:3.0:1784043960.704162:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031cd3e4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:5751:x1870705598661504:12345-0@lo:501: Request processed in 326us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043960.704169:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784043960.704246:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598661504:0@lo:501: 00000100:00100000:2.0:1784043960.704271:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598661632:0@lo:503: 00000100:00100000:2.0:1784043960.704306:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043960.704332:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d38900d6 going to sleep for 11 seconds 00000100:00100000:0.0:1784043960.704385:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598661632 00000100:00100000:0.0:1784043960.704389:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598661632 00000100:00100000:0.0:1784043960.704421:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784043960.704433:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000544a03d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:5751:x1870705598661632:12345-0@lo:503: 00000100:00100000:2.0:1784043960.704678:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598661632:0@lo:503: 00000100:00100000:0.0:1784043960.704774:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000544a03d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:5751:x1870705598661632:12345-0@lo:503: Request processed in 151us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043960.704782:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784043960.708489:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a91c4657 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5792:1870705598661760:0@lo:502: 00000100:00100000:3.0:1784043960.708648:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043960.708694:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set 000000006c09de54 going to sleep for 11 seconds 00000100:00100000:2.0:1784043960.708761:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598661760 00000100:00100000:2.0:1784043960.708775:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598661760 00000100:00100000:2.0:1784043960.708825:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784043960.708833:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022d1c4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:5792:x1870705598661760:12345-0@lo:502: 00000100:00100000:2.0:1784043960.709275:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022d1c4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:5792:x1870705598661760:12345-0@lo:502: Request processed in 442us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043960.709284:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784043960.709567:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a91c4657 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5792:1870705598661760:0@lo:502: 00000020:01000000:2.0:1784043960.709733:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784043960.709745:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043960.709748:0:5792:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784043960.709753:0:5792:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784043960.709755:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784043960.709768:0:5792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a8ef2548) 00000020:00000080:2.0:1784043960.709785:0:5792:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784043960.709790:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784043960.709858:0:5792:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784043960.709877:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a754fd80 00000020:00000080:2.0:1784043960.710168:0:5792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784043960.710172:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784043960.710175:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043960.710177:0:5792:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784043960.710179:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784043960.710182:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043960.710183:0:5792:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784043960.710186:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784043960.710192:0:5792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000000c3fb293) 00000020:00000080:2.0:1784043960.710201:0:5792:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784043960.710204:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784043960.710206:0:5792:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784043960.710208:0:5792:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784043960.710213:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784043960.710262:0:5792:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d870f70d from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784043960.710272:0:5792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000003da9fe72) 00000020:00000080:2.0:1784043960.710284:0:5792:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784043960.710336:0:5792:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784043960.710341:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9cc73983a754fd95 00000020:00000080:2.0:1784043960.710445:0:5792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784043960.710451:0:5792:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784043960.710456:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9cc73983a754fd9c 00080000:01000000:2.0:1784043960.710461:0:5792:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784043960.710464:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a754fda3 00080000:10000000:2.0:1784043960.711148:0:5792:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1784043960.711327:0:5792:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1784043960.717113:0:5792:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1784043960.770509:0:5792:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1784043960.771317:0:5792:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1784043960.777698:0:5792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1784043960.778024:0:5792:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784043960.832991:0:5792:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000eef8e288) 00000020:00000080:3.0:1784043960.833014:0:5792:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784043960.833092:0:5792:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784043960.833097:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a754fdb1 00000020:00000080:1.0:1784043960.838082:0:5792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1784043960.844824:0:5792:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784043960.897770:0:5792:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784043960.951741:0:5792:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784043961.032149:0:5792:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784043961.104244:0:5792:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784043961.183473:0:5792:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1784043961.183757:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784043961.268142:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9cc73983a754fdb8 00000020:00000080:3.0:1784043961.270922:0:5792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784043961.270937:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043961.270945:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043961.270955:0:5792:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784043961.270959:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784043961.270965:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043961.270966:0:5792:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784043961.270969:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784043961.271013:0:5792:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784043961.271099:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043961.271104:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043961.271106:0:5792:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784043961.271108:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784043961.271110:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043961.271111:0:5792:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784043961.271114:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784043961.271115:0:5792:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784043961.271345:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ab42c42 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5792:1870705598661888:0@lo:502: 00000100:00100000:3.0:1784043961.271420:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043961.271551:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fa262f0b going to sleep for 11 seconds 00000100:00100000:0.0:1784043961.271751:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598661888 00000100:00100000:0.0:1784043961.271758:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598661888 00000100:00100000:0.0:1784043961.272382:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784043961.272396:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a49da451 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:5792:x1870705598661888:12345-0@lo:502: 00000100:00100000:0.0:1784043961.274471:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a49da451 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:5792:x1870705598661888:12345-0@lo:502: Request processed in 2071us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043961.274487:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784043961.275400:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ab42c42 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5792:1870705598661888:0@lo:502: 00000020:01000000:3.0:1784043961.275438:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043961.275447:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043961.275449:0:5792:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784043961.275453:0:5792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1784043961.275960:0:5751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1784043961.275992:0:5751:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784043961.276010:0:5751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 000000000ff91b1f/0x9cc73983a754fd6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.276021:0:5751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 000000000ff91b1f/0x9cc73983a754fd6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043961.276038:0:5751:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff904bc9af1000 from 1 10000000:01000000:1.0:1784043961.276041:0:5751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784043961.276096:0:5751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.276103:0:5751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.276112:0:5751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043961.276131:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e2fb35f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662016:0@lo:101: 00000100:00100000:1.0:1784043961.276459:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043961.277110:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 00000000965df5e8 going to sleep for 11 seconds 00000100:00100000:2.0:1784043961.277474:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598662016 00000100:00100000:2.0:1784043961.277483:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598662016 00000100:00100000:2.0:1784043961.277613:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784043961.277622:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca4af63d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:5751:x1870705598662016:12345-0@lo:101: 00010000:00010000:2.0:1784043961.277638:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043961.277654:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000054cccfa6/0x9cc73983a754fdc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fdbf expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043961.277678:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000054cccfa6/0x9cc73983a754fdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fdbf expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043961.277687:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000054cccfa6/0x9cc73983a754fdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fdbf expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043961.277695:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000054cccfa6, rc 0) 00000100:00100000:2.0:1784043961.277966:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca4af63d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:5751:x1870705598662016:12345-0@lo:101: Request processed in 345us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043961.277973:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784043961.278391:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e2fb35f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662016:0@lo:101: 00010000:00010000:1.0:1784043961.278409:0:5751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.278418:0:5751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043961.279898:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e2fb35f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662144:0@lo:256: 00000100:00100000:1.0:1784043961.279959:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043961.279990:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 00000000965df5e8 going to sleep for 11 seconds 00000100:00100000:0.0:1784043961.280113:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598662144 00000100:00100000:0.0:1784043961.280120:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598662144 00000100:00100000:1.0:1784043961.280803:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784043961.280811:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ec53b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:5751:x1870705598662144:12345-0@lo:256: 20000000:01000000:1.0:1784043961.280833:0:5764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784043961.280838:0:5764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1784043961.280937:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ec53b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:5751:x1870705598662144:12345-0@lo:256: Request processed in 127us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043961.280944:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784043961.281101:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e2fb35f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662144:0@lo:256: 10000000:01000000:0.0:1784043961.282434:0:5751:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784043961.282501:0:5751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.282527:0:5751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043961.282535:0:5751:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bc9af1000 from 1 10000000:01000000:0.0:1784043961.282538:0:5751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784043961.282614:0:5751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.282621:0:5751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.282629:0:5751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043961.282647:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b237b634 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662272:0@lo:101: 00000100:00100000:0.0:1784043961.282699:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043961.282896:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f670464 going to sleep for 11 seconds 00000100:00100000:1.0:1784043961.283048:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598662272 00000100:00100000:1.0:1784043961.283056:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598662272 00000100:00100000:1.0:1784043961.283104:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784043961.283113:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009abd798c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:5751:x1870705598662272:12345-0@lo:101: 00010000:00010000:1.0:1784043961.283125:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784043961.283149:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b0efd1fb/0x9cc73983a754fdd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fdcd expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.283168:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b0efd1fb/0x9cc73983a754fdd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fdcd expref: 11 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.283188:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b0efd1fb/0x9cc73983a754fdd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fdcd expref: 11 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.283196:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b0efd1fb, rc 0) 00000100:00100000:1.0:1784043961.283232:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009abd798c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:5751:x1870705598662272:12345-0@lo:101: Request processed in 121us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043961.283247:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784043961.283903:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b237b634 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662272:0@lo:101: 00010000:00010000:0.0:1784043961.283921:0:5751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.283929:0:5751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043961.284008:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b237b634 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662400:0@lo:501: 00000100:00100000:0.0:1784043961.284053:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043961.284079:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f670464 going to sleep for 11 seconds 00000100:00100000:3.0:1784043961.284358:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598662400 00000100:00100000:3.0:1784043961.284364:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598662400 00000100:00100000:3.0:1784043961.284405:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784043961.284412:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c81a5e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:5751:x1870705598662400:12345-0@lo:501: 00000100:00100000:3.0:1784043961.286007:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c81a5e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:5751:x1870705598662400:12345-0@lo:501: Request processed in 1590us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043961.286020:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784043961.286681:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b237b634 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662400:0@lo:501: 00000100:00100000:0.0:1784043961.286819:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b237b634 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662528:0@lo:503: 00000100:00100000:0.0:1784043961.287009:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043961.287162:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f670464 going to sleep for 11 seconds 00000100:00100000:2.0:1784043961.287494:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598662528 00000100:00100000:2.0:1784043961.287503:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598662528 00000100:00100000:2.0:1784043961.287565:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784043961.287573:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007251a41a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:5751:x1870705598662528:12345-0@lo:503: 00000040:00080000:2.0:1784043961.287624:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784043961.287682:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007251a41a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:5751:x1870705598662528:12345-0@lo:503: Request processed in 110us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043961.287689:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784043961.287808:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b237b634 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662528:0@lo:503: 00000040:00080000:2.0:1784043961.289683:0:5796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1784043961.289949:0:5751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1784043961.289973:0:5751:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784043961.290145:0:5751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.290158:0:5751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043961.290340:0:5751:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784043961.290343:0:5751:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff904bc9af1000 10000000:01000000:1.0:1784043961.290346:0:5751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff904bc9af1000 10000000:01000000:1.0:1784043961.290349:0:5751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784043961.290355:0:5751:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904bc9af1000 from 1 10000000:01000000:1.0:1784043961.290358:0:5751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784043961.290389:0:5751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 0000000073c5eb7d/0x9cc73983a754fddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.290397:0:5751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 0000000073c5eb7d/0x9cc73983a754fddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.290406:0:5751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 0000000073c5eb7d/0x9cc73983a754fddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043961.290426:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000082f7c1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662656:0@lo:101: 00000100:00100000:1.0:1784043961.290488:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043961.290543:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 000000008b4e97e9 going to sleep for 11 seconds 00000100:00100000:0.0:1784043961.290619:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598662656 00000100:00100000:0.0:1784043961.290625:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598662656 00000100:00100000:0.0:1784043961.290685:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784043961.290693:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b3ff3be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:5751:x1870705598662656:12345-0@lo:101: 00010000:00010000:0.0:1784043961.290706:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043961.290929:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000018315ac5/0x9cc73983a754fde2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fddb expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.290953:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000018315ac5/0x9cc73983a754fde2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fddb expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.290963:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000018315ac5/0x9cc73983a754fde2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fddb expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.290971:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000018315ac5, rc 0) 00000100:00100000:0.0:1784043961.291016:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b3ff3be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5751:x1870705598662656:12345-0@lo:101: Request processed in 324us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043961.291111:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784043961.291207:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000082f7c1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662656:0@lo:101: 00010000:00010000:1.0:1784043961.291228:0:5751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 0000000073c5eb7d/0x9cc73983a754fddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.291235:0:5751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 0000000073c5eb7d/0x9cc73983a754fddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043961.291465:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000082f7c1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662784:0@lo:501: 00000100:00100000:1.0:1784043961.291496:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043961.291527:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 000000008b4e97e9 going to sleep for 11 seconds 00000100:00100000:2.0:1784043961.291749:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598662784 00000100:00100000:2.0:1784043961.291755:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598662784 00000100:00100000:2.0:1784043961.291795:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784043961.291802:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093b8a1df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5751:x1870705598662784:12345-0@lo:501: 00000100:00100000:2.0:1784043961.292166:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093b8a1df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5751:x1870705598662784:12345-0@lo:501: Request processed in 363us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043961.292329:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784043961.292438:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000082f7c1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662784:0@lo:501: 00000100:00100000:1.0:1784043961.292475:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000082f7c1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662912:0@lo:503: 00000100:00100000:1.0:1784043961.292542:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043961.292567:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 000000008b4e97e9 going to sleep for 11 seconds 00000100:00100000:2.0:1784043961.292758:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598662912 00000100:00100000:2.0:1784043961.292764:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598662912 00000100:00100000:2.0:1784043961.292803:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784043961.292810:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020c1b2d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5751:x1870705598662912:12345-0@lo:503: 00000100:00100000:2.0:1784043961.295579:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020c1b2d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5751:x1870705598662912:12345-0@lo:503: Request processed in 2761us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043961.295595:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784043961.295682:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000082f7c1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598662912:0@lo:503: 00000100:00100000:0.0:1784043961.296679:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000642e29b8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5797:1870705598663040:0@lo:502: 00000100:00100000:0.0:1784043961.296749:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043961.296832:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set 0000000016aed8cc going to sleep for 11 seconds 00000100:00100000:2.0:1784043961.297001:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598663040 00000100:00100000:2.0:1784043961.297008:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598663040 00000100:00100000:2.0:1784043961.297099:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784043961.297107:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058de08aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5797:x1870705598663040:12345-0@lo:502: 00000100:00100000:2.0:1784043961.297552:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058de08aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5797:x1870705598663040:12345-0@lo:502: Request processed in 446us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043961.297560:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784043961.297645:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000642e29b8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5797:1870705598663040:0@lo:502: 00000020:01000004:1.0:1784043961.297706:0:5797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784043961.297731:0:5797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006be55ccb) 00000020:00000080:1.0:1784043961.297750:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1784043961.297998:0:5797:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d870f70d from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784043961.298002:0:5797:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d870f70d from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784043961.298004:0:5797:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d870f70d 4 00010000:00080000:1.0:1784043961.298031:0:5797:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003b7910f1@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:1.0:1784043961.301811:0:5797:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1784043961.301955:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784043961.301993:0:5797:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784043961.302007:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9cc73983a754fdf0 00000100:00080000:1.0:1784043961.302018:0:5797:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784043961.302022:0:5797:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003b7910f1 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1784043961.305880:0:5797:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a8069286 x1870705598663168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784043961.305906:0:5797:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784043961.306073:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a8069286 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870705598663168:0@lo:38: 00000100:00100000:3.0:1784043961.306251:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043961.306393:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598663168 00000100:00100000:1.0:1784043961.306400:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598663168 00000100:00100000:1.0:1784043961.306443:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043961.306450:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ab42c42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1870705598663168:12345-0@lo:38: 00000100:00100000:1.0:1784043961.306506:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ab42c42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1870705598663168:12345-0@lo:38: Request processed in 55us (256us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784043961.306524:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784043961.306788:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784043961.306795:0:3287:0:(import.c:65:import_set_state_nolock()) 000000003b7910f1 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784043961.306800:0:3287:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784043961.306802:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a8069286 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870705598663168:0@lo:38: 00000100:00100000:2.0:1784043961.307068:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5797:1870705598663296:0@lo:502: 00000100:00100000:2.0:1784043961.307114:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043961.307312:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set 00000000778c7187 going to sleep for 11 seconds 00000100:00100000:3.0:1784043961.308822:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598663296 00000100:00100000:3.0:1784043961.308836:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598663296 00000100:00100000:2.0:1784043961.309096:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784043961.309105:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ef2e870 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5797:x1870705598663296:12345-0@lo:502: 00000100:00100000:2.0:1784043961.310643:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ef2e870 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5797:x1870705598663296:12345-0@lo:502: Request processed in 1535us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043961.310655:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784043961.310741:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4d14aee pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5797:1870705598663296:0@lo:502: 00000040:00080000:1.0:1784043961.310782:0:5797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1784043961.311002:0:5751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1784043961.311023:0:5751:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784043961.311148:0:5751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 0000000073c5eb7d/0x9cc73983a754fddb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043961.311159:0:5751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 0000000073c5eb7d/0x9cc73983a754fddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784043961.311215:0:5751:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784043961.311218:0:5751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043961.311219:0:5751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043961.311220:0:5751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043961.311221:0:5751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043961.311222:0:5751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043961.311223:0:5751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043961.311225:0:5751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043961.311226:0:5751:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043961.311227:0:5751:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043961.311229:0:5751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043961.311234:0:5751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784043961.311238:0:5751:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1784043961.311240:0:5751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784043961.311241:0:5751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043961.311242:0:5751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043961.311244:0:5751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043961.311244:0:5751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043961.311245:0:5751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043961.311246:0:5751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043961.311247:0:5751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043961.311247:0:5751:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043961.311248:0:5751:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043961.311249:0:5751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043961.311250:0:5751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784043961.311273:0:5751:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784043961.311286:0:5751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002114ba89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598663424:0@lo:253: 00000100:00100000:2.0:1784043961.311326:0:5751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043961.311363:0:5751:0:(client.c:2702:ptlrpc_set_wait()) set 0000000022e7fc53 going to sleep for 11 seconds 00000100:00100000:0.0:1784043961.311474:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598663424 00000100:00100000:0.0:1784043961.311481:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598663424 00000100:00100000:0.0:1784043961.311537:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784043961.311546:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034f89483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5751:x1870705598663424:12345-0@lo:253: 20000000:01000000:0.0:1784043961.311571:0:5764:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784043961.311584:0:5764:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784043961.366056:0:5764:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784043961.366082:0:5764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784043961.366104:0:5785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784043961.366110:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784043961.366140:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.366181:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000054cccfa6/0x9cc73983a754fdc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fdbf expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.366197:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.366238:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000054cccfa6/0x9cc73983a754fdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fdbf expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.366252:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000054cccfa6/0x9cc73983a754fdc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fdbf expref: 12 pid: 5763 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043961.366266:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e71c58d0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1870705598663552:0@lo:104: 00000100:00100000:0.0:1784043961.366346:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043961.366406:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f9e33050 going to sleep for 11 seconds 00000100:00100000:1.0:1784043961.367548:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598663552 00000100:00100000:1.0:1784043961.367559:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598663552 00000100:00100000:1.0:1784043961.368275:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043961.368285:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000effea101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5785:x1870705598663552:12345-0@lo:104: 00010000:00010000:1.0:1784043961.368302:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043961.368387:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784043961.368393:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000effea101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5785:x1870705598663552:12345-0@lo:104: Request processed in 111us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043961.368397:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e71c58d0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1870705598663552:0@lo:104: 00000100:00100000:1.0:1784043961.368401:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1784043961.368418:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.368474:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784043961.368480:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.368487:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000020284f79 already unused, calling callback (00000000f8e3075e) 10000000:00010000:3.0:1784043961.368489:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.368496:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784043961.368502:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043961.368507:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784043961.368550:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.368556:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784043961.368585:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.368591:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: 0000000020284f79/0x9cc73983a754fdbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fdc6 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.368624:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043961.368626:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043961.368627:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784043961.368672:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784043961.368683:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000043bb32ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598663680:0@lo:103: 00000100:00100000:3.0:1784043961.368720:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043961.368764:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598663680 00000100:00100000:3.0:1784043961.368769:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598663680 00010000:00010000:3.0:1784043961.368786:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000054cccfa6/0x9cc73983a754fdc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fdbf expref: 13 pid: 5763 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043961.368806:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784043961.368811:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c51a4509 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:3288:x1870705598663680:12345-0@lo:103: 00010000:00010000:3.0:1784043961.368821:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784043961.368826:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000054cccfa6/0x9cc73983a754fdc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fdbf expref: 13 pid: 5763 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.369095:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000054cccfa6/0x9cc73983a754fdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fdbf expref: 13 pid: 5763 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.369109:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000054cccfa6/0x9cc73983a754fdc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fdbf expref: 13 pid: 5763 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.369123:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.369130:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784043961.369545:0:5755:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003435701s 00010000:00010000:3.0:1784043961.369549:0:5755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.369555:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.369560:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.369566:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.369571:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079658e8d already unused, calling callback (0000000084d30dcd) 00010000:00010000:3.0:1784043961.369574:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.369581:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.369706:0:5785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043961.369714:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.370613:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.370627:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000079658e8d/0x9cc73983a754fdf7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043961.370646:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784043961.370762:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c51a4509 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3288:x1870705598663680:12345-0@lo:103: Request processed in 1947us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043961.370770:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784043961.372675:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000043bb32ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598663680:0@lo:103: 00000100:00100000:2.0:1784043961.376431:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034f89483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:5751:x1870705598663424:12345-0@lo:253: Request processed in 64879us (65096us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043961.376449:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784043961.376549:0:5751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002114ba89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5751:1870705598663424:0@lo:253: 10000000:01000000:0.0:1784043961.376565:0:5751:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784043961.376568:0:5751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784043961.376584:0:5751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784043961.376586:0:5751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784043961.376587:0:5751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784043961.376588:0:5751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784043961.376589:0:5751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784043961.376590:0:5751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784043961.376592:0:5751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784043961.376593:0:5751:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784043961.376594:0:5751:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784043961.376595:0:5751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784043961.376597:0:5751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784043961.376619:0:5751:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784043961.384750:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1784043961.385372:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784043961.385819:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1784043961.386104:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784043961.386399:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1784043961.386756:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1784043961.387776:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1784043961.388065:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1784043961.388383:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1784043961.388739:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1784043961.389040:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1784043961.389304:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1784043961.437375:0:5751:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1784043961.474101:0:5751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1784043961.474554:0:5803:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1784043961.477331:0:5802:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1784043961.477338:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1784043961.478935:0:5751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784043961.479099:0:5751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784043961.479895:0:5751:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784043961.479906:0:5751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784043961.480073:0:5751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784043961.481137:0:5751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784043961.482118:0:5751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784043961.482371:0:5751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784043961.482817:0:5751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784043961.483080:0:5751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1784043961.491981:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1784043961.492152:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1784043961.495193:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1784043961.495356:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1784043961.495538:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1784043961.495677:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1784043961.495809:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1784043961.496123:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1784043961.496279:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1784043961.496436:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1784043961.496588:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1784043961.496733:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1784043961.496916:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1784043961.497058:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1784043961.497223:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1784043961.497363:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1784043961.497664:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1784043961.497816:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1784043961.497999:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1784043961.498141:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1784043961.498295:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1784043961.498415:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1784043961.502643:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1784043961.502921:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1784043961.503124:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1784043961.503321:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1784043961.503499:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1784043961.503653:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1784043961.503806:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1784043961.503975:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1784043961.504124:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1784043961.504261:0:5751:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1784043961.504486:0:5751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1784043961.522204:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1784043961.580796:0:5751:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784043961.580831:0:5751:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9cac01c6b988 00100000:10000000:1.0:1784043961.580839:0:5751:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784043961.588977:0:5751:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784043961.588997:0:5751:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784043961.589013:0:5751:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1784043961.589031:0:5751:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1784043961.679136:0:5803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784043961.680965:0:5803:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784043961.680980:0:5803:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1784043962.206093:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043963.231097:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043964.253991:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043965.278081:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043966.316805:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784043966.370298:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784043966.370316:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784043966.370319:0:8:0:(import.c:65:import_set_state_nolock()) 000000003b7910f1 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784043966.370331:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003b7910f1 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1784043966.370354:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000060d5d3fa x1870705598663936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784043966.370391:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000060d5d3fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870705598663936:0@lo:38: 00000100:00100000:0.0:1784043966.370472:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043966.377025:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784043966.377052:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e71c58d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598663808:0@lo:400: 00000100:00100000:1.0:1784043966.377131:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043966.377214:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598663808 00000100:00100000:1.0:1784043966.377223:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598663808 00000100:00100000:1.0:1784043966.377263:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784043966.377271:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000463c0057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:3291:x1870705598663808:12345-0@lo:400: 00000100:00100000:1.0:1784043966.377323:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000463c0057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:3291:x1870705598663808:12345-0@lo:400: Request processed in 53us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043966.377330:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784043966.377376:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e71c58d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598663808:0@lo:400: 00000100:00100000:3.0:1784043966.378077:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598663936 00000100:00100000:3.0:1784043966.378084:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598663936 00000100:00100000:3.0:1784043966.378112:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784043966.378117:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028055617 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3287:x1870705598663936:12345-0@lo:38: 00010000:00080000:3.0:1784043966.378141:0:5771:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:3.0:1784043966.378177:0:5771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9cc73983a754fdfe 00000004:00100000:3.0:1784043966.378220:0:5771:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784043966.379266:0:5771:0:(import.c:65:import_set_state_nolock()) 000000003fca1882 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784043966.379399:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028055617 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870705598663936:12345-0@lo:38: Request processed in 1280us (8927us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043966.379408:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784043966.386447:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000060d5d3fa x1870705598663936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784043976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784043966.386472:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784043966.386481:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784043966.386486:0:3287:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784043966.386489:0:3287:0:(import.c:65:import_set_state_nolock()) 000000003b7910f1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784043966.386722:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000060d5d3fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870705598663936:0@lo:38: 00000001:02000400:0.0:1784043966.848796:0:6046:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784043967.332998:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043968.350626:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784043968.927033:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784043968.927049:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff904bc9af1000 from 3 10000000:01000000:0.0:1784043968.927054:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784043968.927106:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 0000000079658e8d/0x9cc73983a754fe05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.927118:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 0000000079658e8d/0x9cc73983a754fe05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.927128:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 0000000079658e8d/0x9cc73983a754fe05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043968.927151:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d92e405 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598664064:0@lo:101: 00000100:00100000:0.0:1784043968.927219:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043968.927300:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f4617e24 going to sleep for 11 seconds 00000100:00100000:2.0:1784043968.927650:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598664064 00000100:00100000:2.0:1784043968.927659:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598664064 00000100:00100000:2.0:1784043968.927715:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784043968.927725:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f2915c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:5766:x1870705598664064:12345-0@lo:101: 00010000:00010000:2.0:1784043968.927739:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043968.927765:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004f97434f/0x9cc73983a754fe0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fe05 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.927790:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f97434f/0x9cc73983a754fe0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fe05 expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.927800:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004f97434f/0x9cc73983a754fe0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe05 expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.927808:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004f97434f, rc 0) 00000100:00100000:2.0:1784043968.927858:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f2915c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5766:x1870705598664064:12345-0@lo:101: Request processed in 136us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.927907:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784043968.928281:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d92e405 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598664064:0@lo:101: 00010000:00010000:0.0:1784043968.928295:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 0000000079658e8d/0x9cc73983a754fe05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.928316:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 0000000079658e8d/0x9cc73983a754fe05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043968.928379:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d92e405 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598664192:0@lo:256: 00000100:00100000:0.0:1784043968.928414:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043968.928448:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f4617e24 going to sleep for 11 seconds 00000100:00100000:1.0:1784043968.928517:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598664192 00000100:00100000:1.0:1784043968.928522:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598664192 00000100:00100000:1.0:1784043968.928559:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784043968.928565:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c317bf13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5766:x1870705598664192:12345-0@lo:256: 20000000:01000000:1.0:1784043968.928589:0:5762:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784043968.928605:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784043968.928608:0:5762:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1784043968.928699:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c317bf13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5766:x1870705598664192:12345-0@lo:256: Request processed in 134us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.928706:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784043968.928954:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d92e405 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598664192:0@lo:256: 10000000:01000000:0.0:1784043968.928999:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784043968.929013:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 0000000079658e8d/0x9cc73983a754fe05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.929021:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 0000000079658e8d/0x9cc73983a754fe05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043969.376435:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043970.398093:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043971.425021:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043971.487058:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784043971.487084:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d92e405 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598664320:0@lo:400: 00000100:00100000:0.0:1784043971.487156:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043971.487220:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000048c71285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598664448:0@lo:400: 00000100:00100000:0.0:1784043971.487247:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043971.487288:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598664320 00000100:00100000:0.0:1784043971.487297:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598664320 00000100:00100000:0.0:1784043971.487358:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784043971.487367:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc79831a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3290:x1870705598664320:12345-0@lo:400: 00000100:00100000:0.0:1784043971.487417:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc79831a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3290:x1870705598664320:12345-0@lo:400: Request processed in 52us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043971.487424:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784043971.487473:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598664448 00000100:00100000:0.0:1784043971.487477:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598664448 00000100:00100000:0.0:1784043971.487503:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784043971.487509:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afc96a56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598664448:12345-0@lo:400: 00000100:00100000:0.0:1784043971.487542:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afc96a56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598664448:12345-0@lo:400: Request processed in 34us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043971.487548:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784043971.487581:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d92e405 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598664320:0@lo:400: 00010000:00080000:0.0:1784043971.487611:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000048c71285 x1870705598664448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043971.487622:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000048c71285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598664448:0@lo:400: 00000020:00000080:3.0:1784043971.802565:0:6248:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebd65fc00 20000000:00000080:3.0:1784043971.802583:0:6248:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff904bfa4d9000 uarg=0000000000000000 20000000:01000000:3.0:1784043971.802618:0:6248:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784043971.802624:0:6248:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784043971.802629:0:6248:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784043971.802834:0:6248:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1784043971.802846:0:6248:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1784043971.816108:0:6248:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784043971.816388:0:6248:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784043971.816449:0:6248:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1784043971.816503:0:6248:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1784043971.816534:0:6248:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784043971.816552:0:6248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043971.816570:0:6248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b0efd1fb/0x9cc73983a754fdd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fdcd expref: 11 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043971.816577:0:6248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043971.816628:0:6248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b0efd1fb/0x9cc73983a754fdd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fdcd expref: 11 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043971.816643:0:6248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b0efd1fb/0x9cc73983a754fdd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fdcd expref: 11 pid: 5764 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043971.816671:0:6248:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7a7a15b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6248:1870705598664576:0@lo:104: 00000100:00100000:2.0:1784043971.816953:0:6248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043971.817076:0:6248:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f4617e24 going to sleep for 11 seconds 00000100:00100000:1.0:1784043971.825117:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598664576 00000100:00100000:1.0:1784043971.825130:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598664576 00000100:00100000:1.0:1784043971.825233:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043971.825241:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005782a0f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:6248:x1870705598664576:12345-0@lo:104: 00010000:00010000:1.0:1784043971.825259:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043971.825355:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784043971.825372:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005782a0f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:6248:x1870705598664576:12345-0@lo:104: Request processed in 132us (8421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043971.825379:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784043971.827530:0:6248:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7a7a15b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6248:1870705598664576:0@lo:104: 00010000:00010000:2.0:1784043971.827560:0:6248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.827641:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784043971.827649:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.827674:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c7fe35cc already unused, calling callback (00000000f8e3075e) 10000000:00010000:3.0:1784043971.827677:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.827686:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784043971.827692:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043971.827697:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784043971.827757:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.827763:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784043971.827784:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.827790:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: 00000000c7fe35cc/0x9cc73983a754fdcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fdd4 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.827809:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043971.827811:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043971.827812:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784043971.827827:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000988cb3cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598664704:0@lo:103: 00000100:00100000:3.0:1784043971.827898:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043971.827962:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598664704 00000100:00100000:3.0:1784043971.827968:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598664704 00010000:00010000:3.0:1784043971.827995:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b0efd1fb/0x9cc73983a754fdd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fdcd expref: 12 pid: 5764 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043971.828039:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784043971.828047:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006310adbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3289:x1870705598664704:12345-0@lo:103: 00010000:00010000:3.0:1784043971.828058:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784043971.828062:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b0efd1fb/0x9cc73983a754fdd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fdcd expref: 12 pid: 5764 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828071:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b0efd1fb/0x9cc73983a754fdd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fdcd expref: 12 pid: 5764 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828085:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b0efd1fb/0x9cc73983a754fdd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fdcd expref: 12 pid: 5764 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828100:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828107:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828122:0:5756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828128:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828134:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828138:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828152:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010ff220a already unused, calling callback (0000000084d30dcd) 00010000:00010000:3.0:1784043971.828155:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828162:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828173:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043971.828181:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784043971.828215:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006310adbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:3289:x1870705598664704:12345-0@lo:103: Request processed in 170us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043971.828223:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784043971.828249:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000988cb3cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598664704:0@lo:103: 00010000:00010000:2.0:1784043971.828915:0:6248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043971.828926:0:6248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043971.828932:0:6248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010ff220a/0x9cc73983a754fe13 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043972.448248:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043973.470378:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043974.497305:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784043974.752554:0:5766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784043974.752562:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bc9af1000 from 1 10000000:01000000:1.0:1784043974.752567:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784043974.752618:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 0000000078e4cff9/0x9cc73983a754fe1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043974.752630:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 0000000078e4cff9/0x9cc73983a754fe1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043974.752639:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 0000000078e4cff9/0x9cc73983a754fe1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043974.752662:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ae99b98e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598664832:0@lo:101: 00000100:00100000:1.0:1784043974.753145:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043974.753202:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 0000000004bc8d9a going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.756049:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598664832 00000100:00100000:2.0:1784043974.756064:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598664832 00000100:00100000:2.0:1784043974.756129:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784043974.756138:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6ed8256 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:5766:x1870705598664832:12345-0@lo:101: 00010000:00010000:2.0:1784043974.756157:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043974.756177:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002e35241d/0x9cc73983a754fe21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fe1a expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043974.756206:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e35241d/0x9cc73983a754fe21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fe1a expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043974.756217:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002e35241d/0x9cc73983a754fe21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe1a expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043974.756243:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002e35241d, rc 0) 00000100:00100000:2.0:1784043974.757058:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6ed8256 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5766:x1870705598664832:12345-0@lo:101: Request processed in 918us (3910us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.757067:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784043974.757246:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ae99b98e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598664832:0@lo:101: 00010000:00010000:1.0:1784043974.757275:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 0000000078e4cff9/0x9cc73983a754fe1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043974.757286:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 0000000078e4cff9/0x9cc73983a754fe1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043974.757626:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ae99b98e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598664960:0@lo:501: 00000100:00100000:1.0:1784043974.757663:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043974.757707:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 0000000004bc8d9a going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.758277:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598664960 00000100:00100000:2.0:1784043974.758285:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598664960 00000100:00100000:2.0:1784043974.758567:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784043974.758577:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0d39838 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5766:x1870705598664960:12345-0@lo:501: 00000100:00100000:2.0:1784043974.759821:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0d39838 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5766:x1870705598664960:12345-0@lo:501: Request processed in 1243us (2156us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.759832:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784043974.759970:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ae99b98e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598664960:0@lo:501: 00000100:00100000:0.0:1784043974.760014:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000048c71285 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598665088:0@lo:503: 00000100:00100000:0.0:1784043974.760057:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043974.760088:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 0000000058a18394 going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.760622:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598665088 00000100:00100000:2.0:1784043974.760629:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598665088 00000100:00100000:2.0:1784043974.760667:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784043974.760674:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022396a26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5766:x1870705598665088:12345-0@lo:503: 00000100:00100000:2.0:1784043974.760856:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022396a26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5766:x1870705598665088:12345-0@lo:503: Request processed in 182us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.760885:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784043974.761019:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000048c71285 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598665088:0@lo:503: 00000100:00100000:0.0:1784043974.761596:0:6404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d92e405 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6404:1870705598665216:0@lo:502: 00000100:00100000:0.0:1784043974.761635:0:6404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043974.761665:0:6404:0:(client.c:2702:ptlrpc_set_wait()) set 0000000058a18394 going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.761711:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598665216 00000100:00100000:2.0:1784043974.761715:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598665216 00000100:00100000:2.0:1784043974.761754:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784043974.761760:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000588336ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6404:x1870705598665216:12345-0@lo:502: 00000100:00100000:2.0:1784043974.761925:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000588336ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6404:x1870705598665216:12345-0@lo:502: Request processed in 166us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.761933:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784043974.762060:0:6404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d92e405 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6404:1870705598665216:0@lo:502: 00000020:01000000:1.0:1784043974.762084:0:6404:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784043974.762092:0:6404:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784043974.762094:0:6404:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784043974.762101:0:6404:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904bc9af1000 00000020:00000080:1.0:1784043974.762104:0:6404:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784043974.762150:0:6404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6404:1870705598665344:0@lo:502: 00000100:00100000:1.0:1784043974.762179:0:6404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043974.762203:0:6404:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5c8d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784043974.762317:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598665344 00000100:00100000:0.0:1784043974.762321:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598665344 00000100:00100000:0.0:1784043974.762355:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784043974.762362:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6404:x1870705598665344:12345-0@lo:502: 00000100:00100000:0.0:1784043974.762498:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6404:x1870705598665344:12345-0@lo:502: Request processed in 136us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043974.762504:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784043974.763024:0:6404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6404:1870705598665344:0@lo:502: 00000020:01000000:1.0:1784043974.763050:0:6404:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784043974.763056:0:6404:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784043974.763058:0:6404:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784043974.763062:0:6404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1784043974.763620:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784043974.763643:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784043974.763652:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663800/0x9cc73983a754fe1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043974.763665:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1663800/0x9cc73983a754fe1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043975.519016:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043976.543042:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784043976.610411:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598665472:0@lo:400: 00000100:00100000:3.0:1784043976.610496:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043976.610556:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784043976.610563:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598665600:0@lo:400: 00000100:00100000:3.0:1784043976.610591:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043976.610627:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598665600 00000100:00100000:3.0:1784043976.610634:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598665600 00000100:00100000:3.0:1784043976.610682:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784043976.610690:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598665600:12345-0@lo:400: 00000100:00100000:3.0:1784043976.610753:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598665600:12345-0@lo:400: Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043976.610761:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784043976.610801:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff904bc4cfe680 x1870705598665600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784043976.610814:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598665600:0@lo:400: 00000100:00100000:2.0:1784043976.611241:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598665472 00000100:00100000:2.0:1784043976.611247:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598665472 00000100:00100000:2.0:1784043976.611288:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784043976.611299:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3290:x1870705598665472:12345-0@lo:400: 00000100:00100000:2.0:1784043976.611340:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3290:x1870705598665472:12345-0@lo:400: Request processed in 45us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043976.611347:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784043976.611896:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598665472:0@lo:400: 00010000:00010000:1.0:1784043977.570252:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784043977.635794:0:6567:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784043977.635798:0:6567:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1784043977.635964:0:6567:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff904beee0a000 00000020:01000004:0.0:1784043977.635978:0:6567:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1784043977.635989:0:6567:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784043977.636001:0:6567:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff904bd40e19c0) 00000020:00000080:0.0:1784043977.636015:0:6567:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784043977.650086:0:6567:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1784043977.650412:0:6567:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784043977.675530:0:6567:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784043977.681571:0:6567:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784043977.681604:0:6567:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784043977.681676:0:6567:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784043977.681705:0:6567:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784043977.682054:0:6567:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784043977.682064:0:6567:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784043977.682075:0:6567:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9cc73983a754fe2f 00000020:01000004:3.0:1784043977.682082:0:6567:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1784043977.682104:0:6567:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784043977.682108:0:6567:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784043977.682113:0:6567:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784043977.682118:0:6567:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1784043977.682131:0:6567:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff904bc5a4cd40) 00000020:00000080:3.0:1784043977.682141:0:6567:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1784043977.684141:0:6567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784043977.684363:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1784043977.684369:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1784043977.690499:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1784043977.690514:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1784043977.690818:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1784043977.690825:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1784043977.696530:0:6567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784043977.696728:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1784043977.696735:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1784043977.698769:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1784043977.698781:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1784043977.739754:0:6567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784043977.741057:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784043977.741066:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1784043977.750278:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784043977.750303:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784043977.752150:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784043977.752164:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1784043977.771287:0:6567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784043977.771499:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1784043977.771514:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1784043977.773567:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1784043977.773580:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1784043977.841804:0:6567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784043977.842011:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1784043977.842018:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1784043977.844322:0:6567:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1784043977.844339:0:6567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1784043977.846618:0:6567:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1784043977.846646:0:6567:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1784043977.846652:0:6567:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784043977.875091:0:6567:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784043977.875130:0:6567:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1784043977.875135:0:6567:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784043977.875137:0:6567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784043977.875139:0:6567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043977.875140:0:6567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043977.875141:0:6567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043977.875143:0:6567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043977.875145:0:6567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784043977.875146:0:6567:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043977.875148:0:6567:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043977.875150:0:6567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043977.875151:0:6567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784043977.875155:0:6567:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1784043977.875163:0:6567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784043977.875164:0:6567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784043977.875165:0:6567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043977.875166:0:6567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043977.875167:0:6567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043977.875168:0:6567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043977.875251:0:6567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784043977.875252:0:6567:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043977.875253:0:6567:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043977.875254:0:6567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043977.875255:0:6567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784043977.875280:0:6567:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784043977.875300:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598665728:0@lo:253: 00000100:00100000:2.0:1784043977.875371:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043977.875602:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598665728 00000100:00100000:0.0:1784043977.875611:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598665728 00000100:00100000:0.0:1784043977.875729:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784043977.875739:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598665728:12345-0@lo:253: 20000000:01000000:0.0:1784043977.875770:0:5762:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784043977.875774:0:5762:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1784043977.875779:0:5762:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1784043977.875782:0:5762:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1784043977.876920:0:5762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784043977.877147:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1784043977.877162:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1784043977.877216:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1784043977.877224:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1784043977.877256:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1784043977.877304:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1784043977.877686:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1784043977.877706:0:5762:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:0.0:1784043977.877708:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:0.0:1784043977.877744:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1784043977.877752:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784043977.877826:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1784043977.877836:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:0.0:1784043977.877924:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1784043977.877935:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1784043977.877969:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1784043977.878039:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1784043977.878725:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1784043977.878741:0:5762:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:0.0:1784043977.878743:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:0.0:1784043977.878775:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1784043977.878782:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784043977.878812:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1784043977.878819:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:0.0:1784043977.878899:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1784043977.878909:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1784043977.878943:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1784043977.878980:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1784043977.878996:0:5762:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1784043977.878999:0:5762:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1784043977.879003:0:5762:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784043977.879023:0:5762:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784043977.879026:0:5762:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784043977.879060:0:5762:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784043977.879063:0:5762:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000100:00100000:2.0:1784043977.880307:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5de3180 going to sleep for 11 seconds 00000040:00080000:2.0:1784043977.887544:0:6582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1784043977.888079:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1784043977.888126:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1784043977.888211:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1784043977.888228:0:5762:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784043977.888231:0:5762:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784043977.890269:0:6583:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1784043977.890350:0:6583:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1784043977.890402:0:6583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1784043977.900277:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1784043977.900337:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1784043977.900441:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1784043977.900481:0:5762:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784043977.900484:0:5762:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784043977.903093:0:6584:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1784043977.903182:0:6584:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1784043977.903249:0:6584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1784043977.903646:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1784043977.903860:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1784043977.904042:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1784043977.904063:0:5762:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1784043977.904066:0:5762:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1784043977.904075:0:5762:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784043977.904095:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.904115:0:5762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc0030a00/0x9cc73983a754fd56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fd4f expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.904124:0:5762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc0030200/0x9cc73983a754fd72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fd6b expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.904131:0:5762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc0031200/0x9cc73983a754fde2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fddb expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.904139:0:5762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.904187:0:5762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc0031200/0x9cc73983a754fde2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fddb expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.904213:0:5762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc0031200/0x9cc73983a754fde2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fddb expref: 12 pid: 5764 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043977.904228:0:5762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598665856:0@lo:104: 00000100:00100000:2.0:1784043977.904290:0:5762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784043977.904394:0:5762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc0030200/0x9cc73983a754fd72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fd6b expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.904402:0:5762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc0030200/0x9cc73983a754fd72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fd6b expref: 12 pid: 5764 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043977.904410:0:5762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cffb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598665984:0@lo:104: 00000100:00100000:2.0:1784043977.904431:0:5762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784043977.909276:0:5762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc0030a00/0x9cc73983a754fd56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fd4f expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.909295:0:5762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc0030a00/0x9cc73983a754fd56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fd4f expref: 12 pid: 5763 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043977.909310:0:5762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cff800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598666112:0@lo:104: 00000100:00100000:2.0:1784043977.909556:0:5762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043977.914104:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598665856 00000100:00100000:0.0:1784043977.914116:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598665984 00000100:00100000:1.0:1784043977.914120:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598665856 00000100:00100000:0.0:1784043977.914123:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598665984 00000100:00100000:1.0:1784043977.914209:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784043977.914220:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:5762:x1870705598665984:12345-0@lo:104: 00010000:00010000:1.0:1784043977.914253:0:5754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc81f5800/0x9cc73983a754fd6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043977.914452:0:5762:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5fd2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784043977.914478:0:5762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cffb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598665984:0@lo:104: 00000100:00100000:0.0:1784043977.914515:0:5753:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1784043977.914523:0:5753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1784043977.914746:0:5754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784043977.914755:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:5762:x1870705598665984:12345-0@lo:104: Request processed in 537us (10322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043977.914763:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784043977.914782:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598666112 00000100:00100000:1.0:1784043977.914787:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598666112 00000100:00100000:1.0:1784043977.914806:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784043977.914813:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:5762:x1870705598665856:12345-0@lo:104: 00010000:00010000:1.0:1784043977.914823:0:5754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043977.914925:0:5762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598665856:0@lo:104: 00000100:00100000:0.0:1784043977.915366:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784043977.915374:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:5762:x1870705598666112:12345-0@lo:104: 00010000:00010000:0.0:1784043977.915384:0:6585:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1678200/0x9cc73983a754fd4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043977.915471:0:5762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cff800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598666112:0@lo:104: 00010000:00010000:2.0:1784043977.915493:0:5762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.917143:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784043977.917157:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f5800/0x9cc73983a754fd6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.917168:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:3.0:1784043977.917172:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5800/0x9cc73983a754fd6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.917183:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f5800/0x9cc73983a754fd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784043977.917190:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5800/0x9cc73983a754fd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043977.917206:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784043977.920217:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784043977.920238:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:5762:x1870705598666112:12345-0@lo:104: Request processed in 4858us (10676us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043977.920251:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784043977.920427:0:5754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784043977.920435:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5762:x1870705598665856:12345-0@lo:104: Request processed in 5622us (16145us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043977.920443:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1784043977.921224:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f5800/0x9cc73983a754fd6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921236:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784043977.921264:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f5800/0x9cc73983a754fd6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921271:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f5800/0x9cc73983a754fd6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fd72 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921287:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784043977.921290:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921314:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784043977.921318:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921326:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784043977.921333:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043977.921338:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784043977.921365:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921371:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784043977.921377:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fddb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921383:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fde2 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921392:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784043977.921395:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1678200/0x9cc73983a754fd4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921400:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1678200 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784043977.921403:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678200/0x9cc73983a754fd4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921419:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1678200/0x9cc73983a754fd4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784043977.921426:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678200/0x9cc73983a754fd4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043977.921431:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784043977.921445:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1678200/0x9cc73983a754fd4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921456:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784043977.921472:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1678200/0x9cc73983a754fd4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921478:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1678200/0x9cc73983a754fd4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fd56 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921494:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043977.921496:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043977.921497:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043977.921513:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598666240:0@lo:103: 00000100:00100000:0.0:1784043977.921575:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043977.921618:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784043977.921624:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598666368:0@lo:103: 00000100:00100000:0.0:1784043977.921645:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043977.921672:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598666496:0@lo:103: 00000100:00100000:0.0:1784043977.921693:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043977.921727:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598666240 00000100:00100000:0.0:1784043977.921739:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598666240 00010000:00010000:0.0:1784043977.921780:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc0030200/0x9cc73983a754fd72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fd6b expref: 13 pid: 5764 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043977.921800:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598666368 00000100:00100000:0.0:1784043977.921803:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598666368 00010000:00010000:0.0:1784043977.921815:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc0031200/0x9cc73983a754fde2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fddb expref: 14 pid: 5764 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043977.921824:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598666496 00000100:00100000:0.0:1784043977.921826:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598666496 00010000:00010000:0.0:1784043977.921835:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc0030a00/0x9cc73983a754fd56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fd4f expref: 15 pid: 5763 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043977.921847:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784043977.921855:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:3288:x1870705598666240:12345-0@lo:103: 00010000:00010000:0.0:1784043977.921893:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784043977.921899:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc0030200/0x9cc73983a754fd72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fd6b expref: 15 pid: 5764 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921921:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc0030200/0x9cc73983a754fd72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fd6b expref: 15 pid: 5764 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921936:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc0030200/0x9cc73983a754fd72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fd6b expref: 15 pid: 5764 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.921952:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784043977.922470:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:3288:x1870705598666240:12345-0@lo:103: Request processed in 613us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043977.922478:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784043977.922495:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784043977.922509:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5ade680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:3288:x1870705598666368:12345-0@lo:103: 00010000:00010000:0.0:1784043977.922528:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784043977.922533:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc0031200/0x9cc73983a754fde2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fddb expref: 13 pid: 5764 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922543:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc0031200/0x9cc73983a754fde2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fddb expref: 13 pid: 5764 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922555:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc0031200/0x9cc73983a754fde2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fddb expref: 13 pid: 5764 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922565:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784043977.922588:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5ade680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3288:x1870705598666368:12345-0@lo:103: Request processed in 80us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043977.922594:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784043977.922607:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784043977.922613:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5aded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:3290:x1870705598666496:12345-0@lo:103: 00010000:00010000:0.0:1784043977.922620:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784043977.922624:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc0030a00/0x9cc73983a754fd56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fd4f expref: 11 pid: 5763 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922633:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc0030a00/0x9cc73983a754fd56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fd4f expref: 11 pid: 5763 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922643:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc0030a00/0x9cc73983a754fd56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fd4f expref: 11 pid: 5763 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922655:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922673:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922687:0:5757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922695:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922702:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922709:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922715:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784043977.922719:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922725:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922743:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922753:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784043977.922781:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5aded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:3290:x1870705598666496:12345-0@lo:103: Request processed in 168us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043977.922787:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784043977.922829:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598666496:0@lo:103: 00010000:00010000:0.0:1784043977.922903:0:5762:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922920:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043977.922925:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f5200/0x9cc73983a754fe3d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784043977.922944:0:5762:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1784043977.923009:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784043977.923304:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598666240:0@lo:103: 00000100:00100000:1.0:1784043977.923320:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598666368:0@lo:103: 00000100:00100000:2.0:1784043977.993281:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:6567:x1870705598665728:12345-0@lo:253: Request processed in 117532us (117898us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043977.993298:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784043977.993505:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598665728:0@lo:253: 10000000:01000000:1.0:1784043977.993521:0:6567:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784043977.993525:0:6567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784043977.993527:0:6567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784043977.993528:0:6567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784043977.993529:0:6567:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1784043977.993531:0:6567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784043977.993550:0:6567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784043977.993552:0:6567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784043977.993554:0:6567:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784043977.993556:0:6567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784043977.993557:0:6567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784043977.993580:0:6567:0:(tgt_mount.c:101:server_register_mount()) register mount ffff904beee0a000 from lustre-OST0000 10000000:01000000:1.0:1784043977.993604:0:6567:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1784043977.993606:0:6567:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784043977.993613:0:6567:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff904bd40e4d40 local copy 10000000:01000000:1.0:1784043977.993617:0:6567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784043977.993655:0:6567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.993744:0:6567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.993755:0:6567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043977.993776:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598666624:0@lo:101: 00000100:00100000:1.0:1784043977.993810:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043977.993860:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589e840 going to sleep for 11 seconds 00000100:00100000:3.0:1784043977.993958:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598666624 00000100:00100000:3.0:1784043977.993972:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598666624 00000100:00100000:3.0:1784043977.994014:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784043977.994022:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:6567:x1870705598666624:12345-0@lo:101: 00010000:00010000:3.0:1784043977.994034:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043977.994046:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1679e00/0x9cc73983a754fe4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fe44 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.994068:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1679e00/0x9cc73983a754fe4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fe44 expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.994078:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1679e00/0x9cc73983a754fe4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe44 expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.994087:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1679e00, rc 0) 00000100:00100000:3.0:1784043977.994127:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:6567:x1870705598666624:12345-0@lo:101: Request processed in 106us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043977.994133:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784043977.994462:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598666624:0@lo:101: 00010000:00010000:1.0:1784043977.994475:0:6567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.994485:0:6567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043977.994599:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598666752:0@lo:501: 00000100:00100000:1.0:1784043977.994624:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043977.994657:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589e840 going to sleep for 11 seconds 00000100:00100000:2.0:1784043977.994790:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598666752 00000100:00100000:2.0:1784043977.994795:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598666752 00000100:00100000:2.0:1784043977.994830:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784043977.994837:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:6567:x1870705598666752:12345-0@lo:501: 00000100:00100000:2.0:1784043977.995474:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:6567:x1870705598666752:12345-0@lo:501: Request processed in 636us (847us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784043977.995483:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784043977.995567:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598666752:0@lo:501: 10000000:01000000:1.0:1784043977.995582:0:6567:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784043977.995612:0:6567:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784043977.995619:0:6567:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.995627:0:6567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.995634:0:6567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.995732:0:6567:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784043977.995754:0:6567:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff904beee0a000 10000000:01000000:1.0:1784043977.995759:0:6567:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784043977.995765:0:6567:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff904bd40e4d40 10000000:01000000:1.0:1784043977.995768:0:6567:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1784043977.995771:0:6567:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff904bd40e4d40 from 1 10000000:01000000:1.0:1784043977.995773:0:6567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784043977.995794:0:6567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662800/0x9cc73983a754fe52 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.995802:0:6567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1662800/0x9cc73983a754fe52 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.995811:0:6567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1662800/0x9cc73983a754fe52 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043977.995826:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598666880:0@lo:101: 00000100:00100000:1.0:1784043977.995895:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043977.995918:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5de3180 going to sleep for 11 seconds 00010000:00010000:3.0:1784043977.996036:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784043977.996042:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.996050:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663200 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:3.0:1784043977.996054:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.996062:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784043977.996069:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043977.996085:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784043977.996104:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.996110:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784043977.996141:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.996149:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1663200/0x9cc73983a754fe44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9cc73983a754fe4b expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.996164:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043977.996166:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043977.996167:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784043977.996175:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784043977.996185:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598667008:0@lo:103: 00000100:00100000:3.0:1784043977.996229:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043977.996337:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598667008 00000100:00100000:3.0:1784043977.996342:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598667008 00000100:00100000:3.0:1784043977.996469:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784043977.996478:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed283100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:3290:x1870705598667008:12345-0@lo:103: 00010000:00010000:3.0:1784043977.996490:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784043977.996504:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1679e00/0x9cc73983a754fe4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a754fe44 expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.996518:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784043977.996549:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed283100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:3290:x1870705598667008:12345-0@lo:103: Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043977.996566:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784043977.996602:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598667008:0@lo:103: 00000100:00100000:2.0:1784043977.996750:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598666880 00000100:00100000:2.0:1784043977.996755:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598666880 00000100:00100000:2.0:1784043977.996790:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784043977.996797:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+9:6567:x1870705598666880:12345-0@lo:101: 00010000:00010000:2.0:1784043977.996809:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043977.996820:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f5600/0x9cc73983a754fe59 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fe52 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.996839:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f5600/0x9cc73983a754fe59 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fe52 expref: 10 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.996849:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f5600/0x9cc73983a754fe59 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe52 expref: 10 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043977.996857:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5600, rc 0) 00000100:00100000:2.0:1784043977.996919:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:6567:x1870705598666880:12345-0@lo:101: Request processed in 122us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043977.997002:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784043977.997099:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598666880:0@lo:101: 00010000:00010000:1.0:1784043977.997112:0:6567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1662800/0x9cc73983a754fe52 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe59 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.997120:0:6567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1662800/0x9cc73983a754fe52 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fe59 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043977.997135:0:6567:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784043977.997154:0:6567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662800/0x9cc73983a754fe52 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe59 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.997162:0:6567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1662800/0x9cc73983a754fe52 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe59 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043977.997171:0:6567:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784043977.997176:0:6567:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784043977.997181:0:6567:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1784043977.997184:0:6567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784043977.997213:0:6567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.997222:0:6567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.997230:0:6567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043977.997242:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667136:0@lo:101: 00000100:00100000:1.0:1784043977.997360:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043977.997450:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5de3180 going to sleep for 11 seconds 00000100:00100000:3.0:1784043977.997532:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598667136 00000100:00100000:3.0:1784043977.997537:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598667136 00000100:00100000:3.0:1784043977.997564:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784043977.997570:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+10:6567:x1870705598667136:12345-0@lo:101: 00010000:00010000:3.0:1784043977.997578:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043977.997588:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1679c00/0x9cc73983a754fe67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fe60 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.997602:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1679c00/0x9cc73983a754fe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fe60 expref: 11 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.997609:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1679c00/0x9cc73983a754fe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe60 expref: 11 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043977.997615:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1679c00, rc 0) 00000100:00100000:3.0:1784043977.997643:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:6567:x1870705598667136:12345-0@lo:101: Request processed in 73us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043977.997649:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784043977.997785:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667136:0@lo:101: 00010000:00010000:1.0:1784043977.997795:0:6567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043977.997803:0:6567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043977.997904:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667264:0@lo:501: 00000100:00100000:1.0:1784043977.998105:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043977.998133:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5de3180 going to sleep for 11 seconds 00000100:00100000:3.0:1784043977.998177:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598667264 00000100:00100000:3.0:1784043977.998182:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598667264 00000100:00100000:3.0:1784043977.998269:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784043977.998276:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:6567:x1870705598667264:12345-0@lo:501: 00000100:00100000:3.0:1784043977.998527:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:6567:x1870705598667264:12345-0@lo:501: Request processed in 250us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043977.998534:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784043977.998602:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667264:0@lo:501: 00000100:00100000:1.0:1784043977.998631:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667392:0@lo:503: 00000100:00100000:1.0:1784043977.999074:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043977.999271:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5de3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784043977.999462:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598667392 00000100:00100000:2.0:1784043977.999469:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598667392 00000100:00100000:2.0:1784043977.999499:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784043977.999506:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:6567:x1870705598667392:12345-0@lo:503: 00000100:00100000:2.0:1784043977.999675:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:6567:x1870705598667392:12345-0@lo:503: Request processed in 168us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043977.999682:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784043978.000169:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667392:0@lo:503: 00000040:00080000:1.0:1784043978.000624:0:6567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784043978.000771:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667520:0@lo:502: 00000100:00100000:1.0:1784043978.000822:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043978.000850:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077780 going to sleep for 11 seconds 00000100:00100000:2.0:1784043978.001100:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598667520 00000100:00100000:2.0:1784043978.001106:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598667520 00000100:00100000:2.0:1784043978.001151:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784043978.001158:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:6567:x1870705598667520:12345-0@lo:502: 00000100:00100000:2.0:1784043978.001591:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:6567:x1870705598667520:12345-0@lo:502: Request processed in 431us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043978.001599:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784043978.001809:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667520:0@lo:502: 00000040:00080000:1.0:1784043978.002252:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784043978.002386:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1784043978.002421:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1784043978.002467:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1784043978.002515:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1784043978.002546:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1784043978.002576:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667648:0@lo:502: 00000100:00100000:1.0:1784043978.002624:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043978.002788:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077780 going to sleep for 11 seconds 00000100:00100000:0.0:1784043978.002894:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598667648 00000100:00100000:0.0:1784043978.002900:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598667648 00000100:00100000:2.0:1784043978.003181:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784043978.003203:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:6567:x1870705598667648:12345-0@lo:502: 00000100:00100000:2.0:1784043978.003535:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:6567:x1870705598667648:12345-0@lo:502: Request processed in 345us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043978.003543:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784043978.003755:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667648:0@lo:502: 00000040:00080000:3.0:1784043978.003855:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784043978.003883:0:6567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1784043978.004807:0:6588:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784043978.004816:0:6588:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1784043978.004822:0:6588:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043978.004824:0:6588:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1784043978.004829:0:6588:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784043978.004842:0:6588:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff904bd40e0000) 00000020:00000080:0.0:1784043978.005004:0:6588:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784043978.005078:0:6588:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784043978.005153:0:6588:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904beee0a000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1784043978.005159:0:6588:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784043978.005165:0:6588:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9cc73983a754fe75 00010000:00010000:1.0:1784043978.010336:0:6588:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1784043978.010762:0:6588:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1784043978.014783:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1784043978.015116:0:6588:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1784043978.029844:0:6588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1784043978.039159:0:6588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1784043978.041148:0:6588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1784043978.041159:0:6588:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784043978.041240:0:6588:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784043978.041243:0:6588:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1784043978.041248:0:6588:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784043978.041315:0:6588:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784043978.041318:0:6588:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784043978.041322:0:6588:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784043978.041324:0:6588:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784043978.041448:0:6588:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784043978.041453:0:6588:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784043978.041455:0:6588:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784043978.041458:0:6588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784043978.045318:0:6567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1784043978.045361:0:6567:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784043978.045391:0:6567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.045406:0:6567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043978.045415:0:6567:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904beee0a000 from 1 10000000:01000000:3.0:1784043978.045417:0:6567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784043978.045459:0:6567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.045468:0:6567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.045479:0:6567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043978.045506:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667776:0@lo:101: 00000100:00100000:3.0:1784043978.045572:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043978.045616:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5075d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784043978.046092:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598667776 00000100:00100000:2.0:1784043978.046099:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598667776 00000100:00100000:2.0:1784043978.046152:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784043978.046162:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:6567:x1870705598667776:12345-0@lo:101: 00010000:00010000:2.0:1784043978.046188:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043978.046211:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f4000/0x9cc73983a754fe83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fe7c expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043978.046245:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f4000/0x9cc73983a754fe83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fe7c expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043978.046452:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f4000/0x9cc73983a754fe83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe7c expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043978.046462:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4000, rc 0) 00000100:00100000:2.0:1784043978.046514:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598667776:12345-0@lo:101: Request processed in 353us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043978.046520:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784043978.046617:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667776:0@lo:101: 00010000:00010000:3.0:1784043978.046632:0:6567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.046641:0:6567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043978.046821:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667904:0@lo:501: 00000100:00100000:3.0:1784043978.046847:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043978.046899:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5075d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784043978.048492:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598667904 00000100:00100000:2.0:1784043978.048504:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598667904 00000100:00100000:2.0:1784043978.048562:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784043978.048573:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598667904:12345-0@lo:501: 00000100:00100000:2.0:1784043978.048905:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598667904:12345-0@lo:501: Request processed in 333us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043978.048913:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784043978.049136:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598667904:0@lo:501: 00000100:00100000:3.0:1784043978.049201:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668032:0@lo:503: 00000100:00100000:3.0:1784043978.049244:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043978.049284:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5075d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784043978.049572:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598668032 00000100:00100000:2.0:1784043978.049578:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598668032 00000100:00100000:2.0:1784043978.049610:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784043978.049617:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598668032:12345-0@lo:503: 00000100:00100000:2.0:1784043978.050476:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598668032:12345-0@lo:503: Request processed in 856us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043978.050484:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784043978.055096:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668032:0@lo:503: 00000040:00080000:1.0:1784043978.057005:0:6567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784043978.057099:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668160:0@lo:502: 00000100:00100000:1.0:1784043978.057376:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043978.057453:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077240 going to sleep for 11 seconds 00000100:00100000:2.0:1784043978.057531:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598668160 00000100:00100000:2.0:1784043978.057537:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598668160 00000100:00100000:2.0:1784043978.057618:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784043978.057634:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598668160:12345-0@lo:502: 00000100:00100000:2.0:1784043978.059087:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598668160:12345-0@lo:502: Request processed in 1448us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043978.059099:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784043978.060507:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668160:0@lo:502: 00000040:00080000:3.0:1784043978.062856:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1784043978.063662:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1784043978.063707:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668288:0@lo:502: 00000100:00100000:3.0:1784043978.063775:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043978.063850:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043978.064053:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598668288 00000100:00100000:2.0:1784043978.064061:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598668288 00000100:00100000:2.0:1784043978.064142:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784043978.064152:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598668288:12345-0@lo:502: 00000100:00100000:2.0:1784043978.064429:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598668288:12345-0@lo:502: Request processed in 277us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043978.064436:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784043978.064635:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668288:0@lo:502: 00000040:00080000:0.0:1784043978.064738:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784043978.064749:0:6567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784043978.065414:0:6592:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784043978.065423:0:6592:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043978.065425:0:6592:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784043978.065431:0:6592:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904beee0a000 00000020:00000080:3.0:1784043978.065433:0:6592:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784043978.065451:0:6592:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043978.065454:0:6592:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043978.065455:0:6592:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784043978.065458:0:6592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1784043978.065586:0:6567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784043978.065607:0:6567:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784043978.065626:0:6567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.065638:0:6567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043978.065675:0:6567:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784043978.065686:0:6567:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff904beee0a000 10000000:01000000:0.0:1784043978.065689:0:6567:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff904beee0a000 10000000:01000000:0.0:1784043978.065693:0:6567:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784043978.065698:0:6567:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904beee0a000 from 1 10000000:01000000:0.0:1784043978.065700:0:6567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784043978.065727:0:6567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.065735:0:6567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.065745:0:6567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043978.065760:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668416:0@lo:101: 00000100:00100000:0.0:1784043978.065799:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043978.065835:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd0063600 going to sleep for 11 seconds 00000100:00100000:3.0:1784043978.066410:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598668416 00000100:00100000:3.0:1784043978.066417:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598668416 00000100:00100000:3.0:1784043978.066460:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784043978.066468:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598668416:12345-0@lo:101: 00010000:00010000:3.0:1784043978.066480:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043978.066492:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1679200/0x9cc73983a754fe91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fe8a expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.066519:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1679200/0x9cc73983a754fe91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fe8a expref: 13 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.066530:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1679200/0x9cc73983a754fe91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe8a expref: 13 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.066538:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1679200, rc 0) 00000100:00100000:3.0:1784043978.066572:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6567:x1870705598668416:12345-0@lo:101: Request processed in 105us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043978.066578:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784043978.066663:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668416:0@lo:101: 00010000:00010000:0.0:1784043978.066677:0:6567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.066685:0:6567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043978.066767:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668544:0@lo:501: 00000100:00100000:0.0:1784043978.066791:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043978.066817:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd0063600 going to sleep for 11 seconds 00000100:00100000:3.0:1784043978.067126:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598668544 00000100:00100000:3.0:1784043978.067130:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598668544 00000100:00100000:3.0:1784043978.067155:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784043978.067161:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6567:x1870705598668544:12345-0@lo:501: 00000100:00100000:3.0:1784043978.067433:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6567:x1870705598668544:12345-0@lo:501: Request processed in 272us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043978.067442:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784043978.067648:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668544:0@lo:501: 00000100:00100000:1.0:1784043978.067695:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668672:0@lo:503: 00000100:00100000:1.0:1784043978.067735:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043978.067762:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077240 going to sleep for 11 seconds 00000100:00100000:2.0:1784043978.067821:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598668672 00000100:00100000:2.0:1784043978.067826:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598668672 00000100:00100000:2.0:1784043978.067925:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784043978.067934:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6567:x1870705598668672:12345-0@lo:503: 00000100:00100000:2.0:1784043978.068103:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6567:x1870705598668672:12345-0@lo:503: Request processed in 170us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043978.068110:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784043978.068230:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668672:0@lo:503: 00000040:00080000:1.0:1784043978.068535:0:6567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784043978.068595:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668800:0@lo:502: 00000100:00100000:1.0:1784043978.068636:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043978.068679:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077240 going to sleep for 11 seconds 00000100:00100000:0.0:1784043978.069608:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598668800 00000100:00100000:0.0:1784043978.069617:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598668800 00000100:00100000:0.0:1784043978.069679:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784043978.069699:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6567:x1870705598668800:12345-0@lo:502: 00000100:00100000:0.0:1784043978.069943:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6567:x1870705598668800:12345-0@lo:502: Request processed in 247us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043978.069952:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784043978.070813:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668800:0@lo:502: 00000040:00080000:1.0:1784043978.071143:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784043978.071221:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784043978.072528:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784043978.072632:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784043978.073086:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784043978.073163:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784043978.073212:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784043978.073248:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784043978.076596:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784043978.076647:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784043978.076759:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784043978.076803:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784043978.076834:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784043978.077111:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784043978.077165:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784043978.077519:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784043978.077561:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784043978.077610:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784043978.077846:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784043978.078042:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784043978.078122:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784043978.078158:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784043978.078204:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784043978.078340:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784043978.078494:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1784043978.078535:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1784043978.078584:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1784043978.078620:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1784043978.078760:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668928:0@lo:502: 00000100:00100000:2.0:1784043978.078837:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043978.078974:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5571e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784043978.079085:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598668928 00000100:00100000:3.0:1784043978.079093:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598668928 00000100:00100000:3.0:1784043978.079180:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784043978.079190:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6567:x1870705598668928:12345-0@lo:502: 00000100:00100000:3.0:1784043978.079508:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6567:x1870705598668928:12345-0@lo:502: Request processed in 318us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043978.079516:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784043978.079610:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598668928:0@lo:502: 00000040:00080000:2.0:1784043978.080039:0:6567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1784043978.080051:0:6567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1784043978.080789:0:6593:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784043978.080814:0:6593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff904bff853380) 00000020:00000080:0.0:1784043978.080833:0:6593:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1784043978.081171:0:6593:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904beee0a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784043978.081176:0:6593:0:(tgt_mount.c:187:server_put_mount()) put mount ffff904beee0a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784043978.081178:0:6593:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904beee0a000 3 00010000:00080000:0.0:1784043978.081224:0:6593:0:(ldlm_lib.c:102:import_set_conn()) imp ffff904bff862800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.150@tcp at head 00010000:00010000:0.0:1784043978.083833:0:6593:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1784043978.084157:0:6593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1784043978.084209:0:6593:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784043978.084222:0:6593:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9cc73983a754fe9f 00000100:00080000:0.0:1784043978.084233:0:6593:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784043978.084239:0:6593:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff904bff862800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1784043978.084291:0:6593:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bc5adc700 x1870705598669056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784043978.084317:0:6593:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784043978.084447:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784043978.084462:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598669184:0@lo:400: 00000100:00100000:2.0:1784043978.084528:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043978.084577:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598669184 00000100:00100000:2.0:1784043978.084584:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598669184 00000100:00100000:1.0:1784043978.084675:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1870705598669056:0@lo:38: 00000100:00100000:1.0:1784043978.084710:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043978.086925:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598669056 00000100:00100000:2.0:1784043978.086936:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598669056 00000100:00100000:2.0:1784043978.086965:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784043978.086979:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598669184:12345-0@lo:400: 00000100:00100000:2.0:1784043978.087058:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598669184:12345-0@lo:400: Request processed in 84us (2530us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043978.087066:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784043978.087084:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784043978.087096:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1870705598669056:12345-0@lo:38: 00010000:00080000:2.0:1784043978.087117:0:5769:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1784043978.087151:0:5769:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9cc73983a754fea6 00000004:00100000:2.0:1784043978.087167:0:5769:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784043978.087208:0:5769:0:(import.c:65:import_set_state_nolock()) ffff904bd437c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784043978.087248:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870705598669056:12345-0@lo:38: Request processed in 150us (2536us total) trans 0 rc 0/0 00010000:00080000:1.0:1784043978.087407:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff904bc4cff800 x1870705598669184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043978.087423:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598669184:0@lo:400: 00010000:00080000:1.0:1784043978.087454:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff904bc5adc700 x1870705598669056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784043988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043978.087463:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784043978.087469:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1784043978.087482:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784043978.087486:0:3287:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784043978.087489:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bff862800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784043978.087494:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1870705598669056:0@lo:38: 00000100:00100000:2.0:1784043978.087543:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1784043978.088247:0:6593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1784043978.093656:0:6567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1784043978.093699:0:6567:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784043978.093769:0:6567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.093792:0:6567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784043978.093897:0:6567:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784043978.093900:0:6567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784043978.093902:0:6567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784043978.093903:0:6567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784043978.093904:0:6567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784043978.093906:0:6567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784043978.093907:0:6567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784043978.093909:0:6567:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784043978.093910:0:6567:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784043978.093912:0:6567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784043978.093914:0:6567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784043978.093918:0:6567:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1784043978.093920:0:6567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784043978.093922:0:6567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784043978.093923:0:6567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784043978.093924:0:6567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784043978.093925:0:6567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784043978.093926:0:6567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784043978.093927:0:6567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784043978.093928:0:6567:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784043978.093929:0:6567:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784043978.093931:0:6567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784043978.093932:0:6567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784043978.093958:0:6567:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784043978.093978:0:6567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598669312:0@lo:253: 00000100:00100000:0.0:1784043978.094048:0:6567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043978.094082:0:6567:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5a62b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784043978.094157:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598669312 00000100:00100000:2.0:1784043978.094165:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598669312 00000100:00100000:2.0:1784043978.094225:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784043978.094234:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6567:x1870705598669312:12345-0@lo:253: 20000000:01000000:2.0:1784043978.094271:0:5764:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784043978.094285:0:5764:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784043978.113126:0:5764:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784043978.113148:0:5764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784043978.113341:0:5785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784043978.113347:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784043978.113369:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.113403:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc81f4400/0x9cc73983a754fe0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe05 expref: 13 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.113411:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.113451:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc81f4400/0x9cc73983a754fe0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fe05 expref: 13 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.113465:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc81f4400/0x9cc73983a754fe0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fe05 expref: 13 pid: 5764 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043978.113479:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1870705598669440:0@lo:104: 00000100:00100000:0.0:1784043978.113544:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043978.113598:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5a620c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043978.113736:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598669440 00000100:00100000:2.0:1784043978.113743:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598669440 00000100:00100000:2.0:1784043978.113791:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784043978.113800:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5785:x1870705598669440:12345-0@lo:104: 00010000:00010000:2.0:1784043978.113812:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fe05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043978.113887:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784043978.113893:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5785:x1870705598669440:12345-0@lo:104: Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043978.113899:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784043978.114026:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1870705598669440:0@lo:104: 00010000:00010000:0.0:1784043978.114056:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.115463:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784043978.115475:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fe05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.115506:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031800 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:3.0:1784043978.115510:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fe05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.115519:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fe05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784043978.115525:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fe05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043978.115530:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784043978.115577:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fe05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.115583:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784043978.115600:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fe05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.115606:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fe05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe0c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.115624:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043978.115627:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043978.115629:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043978.115682:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598669568:0@lo:103: 00000100:00100000:0.0:1784043978.115739:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043978.115841:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598669568 00000100:00100000:3.0:1784043978.115848:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598669568 00010000:00010000:3.0:1784043978.115905:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc81f4400/0x9cc73983a754fe0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fe05 expref: 14 pid: 5764 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043978.115932:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784043978.115949:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:3289:x1870705598669568:12345-0@lo:103: 00010000:00010000:3.0:1784043978.115962:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784043978.115968:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc81f4400/0x9cc73983a754fe0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fe05 expref: 14 pid: 5764 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.115979:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc81f4400/0x9cc73983a754fe0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fe05 expref: 14 pid: 5764 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.115994:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f4400/0x9cc73983a754fe0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fe05 expref: 14 pid: 5764 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.116007:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.116016:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784043978.116032:0:5755:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003435701s 00010000:00010000:3.0:1784043978.116036:0:5755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.116042:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.116048:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.116054:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.116059:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784043978.116071:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.116078:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.116090:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043978.116102:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784043978.116138:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:3289:x1870705598669568:12345-0@lo:103: Request processed in 191us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043978.116146:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784043978.116282:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598669568:0@lo:103: 00010000:00010000:0.0:1784043978.116304:0:5785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.116312:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043978.116328:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc0031200/0x9cc73983a754fead lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043978.126039:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:6567:x1870705598669312:12345-0@lo:253: Request processed in 31796us (31980us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043978.126054:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784043978.126156:0:6567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6567:1870705598669312:0@lo:253: 10000000:01000000:3.0:1784043978.126171:0:6567:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784043978.126175:0:6567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784043978.126177:0:6567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784043978.126178:0:6567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784043978.126179:0:6567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784043978.126180:0:6567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784043978.126181:0:6567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784043978.126183:0:6567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784043978.126184:0:6567:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784043978.126186:0:6567:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784043978.126188:0:6567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784043978.126200:0:6567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784043978.126214:0:6567:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784043978.131690:0:6567:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784043978.131856:0:6567:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784043978.132107:0:6567:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784043978.132390:0:6567:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784043978.132620:0:6567:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784043978.133026:0:6567:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784043978.134067:0:6567:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1784043978.350503:0:6567:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1784043978.350510:0:6567:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1784043978.350544:0:6567:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784043978.350605:0:6567:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784043978.350620:0:6567:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784043978.350649:0:6567:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1784043978.590084:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043979.615672:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043980.638117:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043981.662815:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043982.686004:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784043983.271049:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598669696:0@lo:400: 00000100:00100000:1.0:1784043983.271128:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043983.281945:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598669824:0@lo:400: 00000100:00100000:1.0:1784043983.282022:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043983.282104:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598669696 00000100:00100000:1.0:1784043983.282111:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598669696 00000100:00100000:1.0:1784043983.282168:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784043983.282178:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3290:x1870705598669696:12345-0@lo:400: 00000100:00100000:1.0:1784043983.282226:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3290:x1870705598669696:12345-0@lo:400: Request processed in 50us (11097us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043983.282233:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784043983.282264:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598669824 00000100:00100000:1.0:1784043983.282268:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598669824 00000100:00100000:1.0:1784043983.282296:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784043983.282303:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598669824:12345-0@lo:400: 00000100:00100000:1.0:1784043983.282337:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598669824:12345-0@lo:400: Request processed in 34us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043983.282343:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784043983.282381:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bed282a00 x1870705598669824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043983.282394:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598669824:0@lo:400: 00000100:00100000:1.0:1784043983.282461:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598669696:0@lo:400: 00000100:00100000:2.0:1784043983.283263:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598669952:0@lo:400: 00000100:00100000:2.0:1784043983.283309:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043983.283402:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598669952 00000100:00100000:3.0:1784043983.283408:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598669952 00000100:00100000:3.0:1784043983.283524:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784043983.283534:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598669952:12345-0@lo:400: 00000100:00100000:3.0:1784043983.283581:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598669952:12345-0@lo:400: Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043983.283589:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1784043983.283687:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784043983.283711:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bed283100 x1870705598669952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043983.283722:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598669952:0@lo:400: 00010000:00010000:1.0:1784043983.710013:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784043984.289574:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784043984.289581:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904bc9af1000 from 21 10000000:01000000:2.0:1784043984.289588:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784043984.289636:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043984.289648:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043984.289659:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043984.289684:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670080:0@lo:101: 00000100:00100000:2.0:1784043984.289751:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043984.289811:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc52d4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784043984.290311:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598670080 00000100:00100000:0.0:1784043984.290320:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598670080 00000100:00100000:0.0:1784043984.290389:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784043984.290399:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5766:x1870705598670080:12345-0@lo:101: 00010000:00010000:0.0:1784043984.290414:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043984.290429:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc0031000/0x9cc73983a754febb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754feb4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043984.290454:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc0031000/0x9cc73983a754febb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754feb4 expref: 13 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043984.290466:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc0031000/0x9cc73983a754febb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754feb4 expref: 13 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043984.290474:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031000, rc 0) 00000100:00100000:0.0:1784043984.290519:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598670080:12345-0@lo:101: Request processed in 121us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043984.290546:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784043984.290808:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670080:0@lo:101: 00010000:00010000:2.0:1784043984.290826:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043984.290836:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043984.290939:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670208:0@lo:501: 00000100:00100000:2.0:1784043984.290971:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043984.292553:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc52d4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784043984.294427:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598670208 00000100:00100000:0.0:1784043984.294446:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598670208 00000100:00100000:0.0:1784043984.294548:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784043984.294559:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598670208:12345-0@lo:501: 00000100:00100000:0.0:1784043984.294995:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598670208:12345-0@lo:501: Request processed in 437us (4022us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043984.295005:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784043984.295120:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670208:0@lo:501: 00000100:00100000:1.0:1784043984.295173:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670336:0@lo:503: 00000100:00100000:1.0:1784043984.295228:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043984.299164:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc89799c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784043984.300510:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598670336 00000100:00100000:3.0:1784043984.300523:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598670336 00000100:00100000:3.0:1784043984.300572:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784043984.300581:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598670336:12345-0@lo:503: 00000100:00100000:3.0:1784043984.300980:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598670336:12345-0@lo:503: Request processed in 399us (5751us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043984.300988:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784043984.301049:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670336:0@lo:503: 00000100:00100000:0.0:1784043984.308793:0:6882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6882:1870705598670464:0@lo:502: 00000100:00100000:0.0:1784043984.308914:0:6882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043984.308950:0:6882:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784043984.309070:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598670464 00000100:00100000:3.0:1784043984.309087:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598670464 00000100:00100000:3.0:1784043984.309130:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784043984.309139:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6882:x1870705598670464:12345-0@lo:502: 00000100:00100000:3.0:1784043984.309682:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6882:x1870705598670464:12345-0@lo:502: Request processed in 541us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043984.309699:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784043984.311534:0:6882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6882:1870705598670464:0@lo:502: 00000100:00100000:1.0:1784043984.311620:0:6882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6882:1870705598670592:0@lo:502: 00000100:00100000:1.0:1784043984.311685:0:6882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043984.311786:0:6882:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc8979d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784043984.314577:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598670592 00000100:00100000:0.0:1784043984.314593:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598670592 00000100:00100000:0.0:1784043984.314661:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784043984.314672:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6882:x1870705598670592:12345-0@lo:502: 00000100:00100000:0.0:1784043984.314978:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:6882:x1870705598670592:12345-0@lo:502: Request processed in 307us (3292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043984.314986:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784043984.315145:0:6882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6882:1870705598670592:0@lo:502: 00000040:00080000:1.0:1784043984.315182:0:6882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1784043984.315562:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1784043984.315583:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784043984.315594:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043984.315605:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043984.315615:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784043984.315618:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff904bc9af1000 from 4 10000000:01000000:0.0:1784043984.315621:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784043984.315653:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043984.315668:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043984.315679:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043984.315699:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670720:0@lo:101: 00000100:00100000:0.0:1784043984.315737:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043984.315775:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784043984.315979:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598670720 00000100:00100000:1.0:1784043984.315984:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598670720 00000100:00100000:1.0:1784043984.316013:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784043984.316021:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598670720:12345-0@lo:101: 00010000:00010000:1.0:1784043984.316031:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784043984.316045:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1662e00/0x9cc73983a754fec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fec2 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043984.316066:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1662e00/0x9cc73983a754fec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fec2 expref: 14 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043984.316090:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1662e00/0x9cc73983a754fec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fec2 expref: 14 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043984.316111:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662e00, rc 0) 00000100:00100000:1.0:1784043984.316156:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598670720:12345-0@lo:101: Request processed in 136us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043984.316163:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784043984.316453:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670720:0@lo:101: 00010000:00010000:3.0:1784043984.316467:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043984.316475:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043984.316526:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed280a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670848:0@lo:256: 00000100:00100000:3.0:1784043984.316559:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043984.316589:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077840 going to sleep for 11 seconds 00000100:00100000:1.0:1784043984.316632:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598670848 00000100:00100000:1.0:1784043984.316637:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598670848 00000100:00100000:1.0:1784043984.316668:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784043984.316675:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598670848:12345-0@lo:256: 20000000:01000000:1.0:1784043984.316689:0:5764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784043984.316704:0:5764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784043984.316707:0:5764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1784043984.316793:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598670848:12345-0@lo:256: Request processed in 117us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043984.316800:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784043984.316888:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed280a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670848:0@lo:256: 10000000:01000000:3.0:1784043984.316931:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784043984.316938:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043984.316946:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043984.316953:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784043984.316955:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1784043984.316958:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784043984.316974:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043984.316982:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043984.317001:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043984.317014:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed280a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670976:0@lo:101: 00000100:00100000:3.0:1784043984.317041:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043984.317060:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077840 going to sleep for 11 seconds 00000100:00100000:1.0:1784043984.317136:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598670976 00000100:00100000:1.0:1784043984.317141:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598670976 00000100:00100000:1.0:1784043984.317164:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784043984.317170:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598670976:12345-0@lo:101: 00010000:00010000:1.0:1784043984.317178:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784043984.317191:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1663600/0x9cc73983a754fed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fed0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043984.317441:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1663600/0x9cc73983a754fed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fed0 expref: 15 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043984.317451:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1663600/0x9cc73983a754fed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fed0 expref: 15 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043984.317468:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663600, rc 0) 00000100:00100000:1.0:1784043984.317592:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598670976:12345-0@lo:101: Request processed in 421us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043984.317599:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784043984.321967:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed280a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598670976:0@lo:101: 00010000:00010000:3.0:1784043984.321997:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043984.322010:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043984.322100:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed280a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598671104:0@lo:501: 00000100:00100000:3.0:1784043984.322159:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043984.322337:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077840 going to sleep for 11 seconds 00000100:00100000:3.0:1784043984.322439:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598671104 00000100:00100000:3.0:1784043984.322446:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598671104 00000100:00100000:3.0:1784043984.322503:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784043984.322512:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598671104:12345-0@lo:501: 00000100:00100000:3.0:1784043984.322785:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598671104:12345-0@lo:501: Request processed in 273us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043984.322793:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784043984.322837:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed280a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598671104:0@lo:501: 00000100:00100000:3.0:1784043984.322888:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed280a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598671232:0@lo:503: 00000100:00100000:3.0:1784043984.322934:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043984.322951:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077840 going to sleep for 11 seconds 00000100:00100000:3.0:1784043984.322965:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598671232 00000100:00100000:3.0:1784043984.322969:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598671232 00000100:00100000:3.0:1784043984.322993:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784043984.322999:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598671232:12345-0@lo:503: 00000100:00100000:3.0:1784043984.323901:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598671232:12345-0@lo:503: Request processed in 897us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043984.323912:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784043984.324334:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed280a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598671232:0@lo:503: 00000100:00100000:1.0:1784043984.328850:0:6883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6883:1870705598671360:0@lo:502: 00000100:00100000:1.0:1784043984.329043:0:6883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043984.329095:0:6883:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5de3180 going to sleep for 11 seconds 00000100:00100000:0.0:1784043984.329178:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598671360 00000100:00100000:0.0:1784043984.329186:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598671360 00000100:00100000:0.0:1784043984.329255:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784043984.329265:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:6883:x1870705598671360:12345-0@lo:502: 00000100:00100000:0.0:1784043984.329702:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:6883:x1870705598671360:12345-0@lo:502: Request processed in 437us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043984.329710:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784043984.329816:0:6883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6883:1870705598671360:0@lo:502: 00000020:01000000:1.0:1784043984.329849:0:6883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784043984.329856:0:6883:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784043984.329897:0:6883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784043984.329900:0:6883:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784043984.329908:0:6883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784043984.329912:0:6883:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:1.0:1784043984.329934:0:6883:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784043984.329937:0:6883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784043984.329952:0:6883:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff904bed5c4d40) 00000020:00000080:1.0:1784043984.329972:0:6883:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784043984.329978:0:6883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784043984.330069:0:6883:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784043984.330085:0:6883:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784043984.330093:0:6883:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a754fee5 00010000:00080000:1.0:1784043984.330120:0:6883:0:(ldlm_lib.c:102:import_set_conn()) imp ffff904bf738f800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:1.0:1784043984.330493:0:6883:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1784043984.397225:0:6883:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784043984.397253:0:6883:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784043984.399328:0:6883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784043984.399628:0:6883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784043984.400204:0:6883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1784043984.400277:0:6883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1784043984.401020:0:6888:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784043984.401026:0:6888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784043984.401618:0:6883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784043984.401630:0:6883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784043984.401687:0:6883:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784043984.401709:0:6883:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9cc73983a754feec 00000100:00080000:0.0:1784043984.401720:0:6883:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784043984.401726:0:6883:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff904bf738f800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1784043984.401764:0:6883:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bc5adf480 x1870705598671488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784043984.401791:0:6883:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784043984.401887:0:6883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784043984.401892:0:6883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043984.401894:0:6883:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784043984.401897:0:6883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784043984.401900:0:6883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043984.401902:0:6883:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784043984.401905:0:6883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784043984.401906:0:6883:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784043984.401912:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598671488:0@lo:8: 00000100:00100000:0.0:1784043984.401929:0:6883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6883:1870705598671616:0@lo:502: 00000100:00100000:3.0:1784043984.402061:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598671872:0@lo:400: 00000100:00100000:2.0:1784043984.402147:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598671744:0@lo:400: 00000100:00100000:1.0:1784043984.402441:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043984.402527:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598671488 00000100:00100000:1.0:1784043984.402534:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598671488 00000100:00100000:1.0:1784043984.402564:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043984.402571:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1870705598671488:12345-0@lo:8: 00010000:00080000:1.0:1784043984.402595:0:6569:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:1.0:1784043984.402622:0:6569:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9cc73983a754fef3 00002000:00100000:1.0:1784043984.402654:0:6569:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff904bc5019000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784043984.402659:0:6569:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1784043984.402663:0:6569:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1784043984.402774:0:6569:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784043984.402957:0:6569:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784043984.402982:0:6569:0:(import.c:65:import_set_state_nolock()) ffff904bc501a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784043984.403035:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1870705598671488:12345-0@lo:8: Request processed in 463us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043984.403044:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784043984.403101:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc5adf480 x1870705598671488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784043994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043984.403112:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784043984.403119:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784043984.403127:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784043984.403145:0:3287:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784043984.403148:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bf738f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784043984.403159:0:3287:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784043984.403164:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598671488:0@lo:8: 00000004:00080000:1.0:1784043984.403426:0:6888:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784043984.403526:0:6888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 162388661121ns, next at 0ns, rc = 0 00000100:00100000:0.0:1784043984.403581:0:6883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043984.403608:0:6883:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5571f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784043984.403918:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598671616 00000100:00100000:3.0:1784043984.403923:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598671616 00000100:00100000:3.0:1784043984.403956:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784043984.403965:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:6883:x1870705598671616:12345-0@lo:502: 00000100:00100000:3.0:1784043984.404174:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:6883:x1870705598671616:12345-0@lo:502: Request processed in 210us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043984.404180:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784043984.404625:0:6883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:6883:1870705598671616:0@lo:502: 00000020:01000000:3.0:1784043984.404654:0:6883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043984.404660:0:6883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043984.404662:0:6883:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784043984.404667:0:6883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1784043984.406096:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1784043984.406120:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784043984.406135:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043984.406159:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043984.406169:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784043984.406171:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff904bd40e4d40 from 1 10000000:01000000:3.0:1784043984.406174:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784043984.406564:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043984.406574:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043984.406585:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043984.406607:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed280700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598672000:0@lo:101: 00000100:00100000:3.0:1784043984.406665:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043984.406728:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc380f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784043984.406760:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043984.406920:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598671872 00000100:00100000:0.0:1784043984.406928:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598671872 00000100:00100000:0.0:1784043984.406969:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784043984.406978:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598671872:12345-0@lo:400: 00000100:00100000:2.0:1784043984.407020:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043984.407026:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598671872:12345-0@lo:400: Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043984.407033:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784043984.407045:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598671744 00000100:00100000:0.0:1784043984.407048:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598671744 00000100:00100000:0.0:1784043984.407090:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784043984.407096:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598671744:12345-0@lo:400: 00000100:00100000:0.0:1784043984.407151:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598671744:12345-0@lo:400: Request processed in 54us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043984.407157:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784043984.407167:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bed282680 x1870705598671744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043984.407180:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598671744:0@lo:400: 00010000:00080000:3.0:1784043984.407527:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bed282d80 x1870705598671872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784043984.407537:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598671872:0@lo:400: 00000100:00100000:0.0:1784043984.412504:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598672000 00000100:00100000:0.0:1784043984.412519:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598672000 00000100:00100000:0.0:1784043984.412574:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784043984.412583:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598672000:12345-0@lo:101: 00010000:00010000:0.0:1784043984.412599:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043984.412616:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc0031200/0x9cc73983a754ff01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754fefa expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043984.412642:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc0031200/0x9cc73983a754ff01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754fefa expref: 16 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043984.412652:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc0031200/0x9cc73983a754ff01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fefa expref: 16 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043984.412673:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031200, rc 0) 00000100:00100000:0.0:1784043984.412753:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598672000:12345-0@lo:101: Request processed in 171us (6087us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043984.412760:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784043984.413456:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed280700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598672000:0@lo:101: 00010000:00010000:3.0:1784043984.413480:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043984.413489:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043984.413567:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed280700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598672128:0@lo:501: 00000100:00100000:3.0:1784043984.413605:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043984.413643:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc380f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784043984.413652:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598672128 00000100:00100000:0.0:1784043984.413657:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598672128 00000100:00100000:0.0:1784043984.413698:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784043984.413704:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598672128:12345-0@lo:501: 00000100:00100000:0.0:1784043984.413893:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598672128:12345-0@lo:501: Request processed in 188us (286us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784043984.413902:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784043984.414494:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed280700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598672128:0@lo:501: 10000000:01000000:3.0:1784043984.414522:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784043984.414529:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043984.414538:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784043984.449678:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1784043984.473251:0:6889:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784043984.473269:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598672256:0@lo:13: 00000100:00100000:2.0:1784043984.473279:0:6889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1870705598672384:0@lo:7: 00000100:00100000:1.0:1784043984.473385:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043984.473513:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598672256 00000100:00100000:0.0:1784043984.473521:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598672256 00000100:00100000:0.0:1784043984.473608:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784043984.473617:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1870705598672256:12345-0@lo:13: 00002000:00000024:0.0:1784043984.473647:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1784043984.473693:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1870705598672256:12345-0@lo:13: Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043984.473700:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784043984.473751:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc4cfd180 x1870705598672256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043984.473768:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598672256:0@lo:13: 00000100:00080000:0.0:1784043984.473937:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784043984.474117:0:6889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043984.474179:0:6889:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc52d4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784043984.474257:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598672384 00000100:00100000:1.0:1784043984.474261:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598672384 00000100:00100000:1.0:1784043984.474327:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043984.474335:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6889:x1870705598672384:12345-0@lo:7: 00002000:00080000:1.0:1784043984.479637:0:6572:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1784043984.479646:0:6572:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1784043984.479743:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6889:x1870705598672384:12345-0@lo:7: Request processed in 5404us (5620us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043984.479754:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784043984.481486:0:6889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc4cfce00 x1870705598672384/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784044000 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043984.481508:0:6889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1870705598672384:0@lo:7: 00000004:00080000:0.0:1784043984.481525:0:6889:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1784043984.481567:0:6889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1870705598672512:0@lo:5: 00000100:00100000:0.0:1784043984.481619:0:6889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043984.481715:0:6889:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7c550c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784043984.481766:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598672512 00000100:00100000:1.0:1784043984.481774:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598672512 00000100:00100000:1.0:1784043984.481889:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784043984.481899:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6889:x1870705598672512:12345-0@lo:5: 00002000:00080000:1.0:1784043984.481924:0:6571:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1784043984.481928:0:6571:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1784043984.482461:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6889:x1870705598672512:12345-0@lo:5: Request processed in 563us (841us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784043984.482473:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784043984.482541:0:6889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc5adce00 x1870705598672512/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044000 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043984.482556:0:6889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1870705598672512:0@lo:5: 00000004:00080000:1.0:1784043984.482566:0:6889:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784043984.482598:0:6889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1870705598672640:0@lo:700: 00000100:00100000:1.0:1784043984.482626:0:6889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043984.482644:0:6889:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5078600 going to sleep for 11 seconds 00000100:00100000:1.0:1784043984.482671:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598672640 00000100:00100000:1.0:1784043984.482675:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598672640 00000100:00100000:1.0:1784043984.482706:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043984.482713:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6889:x1870705598672640:12345-0@lo:700: 00000100:00100000:1.0:1784043984.482742:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6578:1870705598672768:0@lo:700: 00000100:00100000:1.0:1784043984.482770:0:6578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043984.482786:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5078cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784043984.482816:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598672768 00000100:00100000:1.0:1784043984.482820:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598672768 00000100:00100000:1.0:1784043984.482854:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043984.482861:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6578:x1870705598672768:12345-0@lo:700: 00000100:00100000:2.0:1784043984.482882:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 2 min 2 max 256 00000100:00100000:2.0:1784043984.482889:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0002' 40000000:02000000:1.0:1784043984.536699:0:5776:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1784043984.545061:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6578:x1870705598672768:12345-0@lo:700: Request processed in 62192us (62281us total) trans 0 rc 0/0 00010000:00080000:0.0:1784043984.545098:0:6578:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904beeef0380 x1870705598672768/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784044000 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043984.545113:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784043984.545114:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6578:1870705598672768:0@lo:700: 40000000:02000000:0.0:1784043984.545126:0:6578:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1784043984.657582:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1784043984.657604:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784043984.660639:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6889:x1870705598672640:12345-0@lo:700: Request processed in 177916us (178002us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043984.660662:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784043984.660917:0:6889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904beeef0000 x1870705598672640/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784044000 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043984.660929:0:6889:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784043984.660949:0:6889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1870705598672640:0@lo:700: 00000004:02000040:1.0:1784043984.733616:0:6889:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1784043984.749048:0:6889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1870705598672896:0@lo:5: 00000100:00100000:1.0:1784043984.749271:0:6889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043984.749325:0:6889:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5078540 going to sleep for 11 seconds 00000100:00100000:2.0:1784043984.749503:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598672896 00000100:00100000:2.0:1784043984.749512:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598672896 00000100:00100000:2.0:1784043984.749569:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784043984.749579:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6889:x1870705598672896:12345-0@lo:5: 00010000:00010000:0.0:1784043984.755809:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784043984.769891:0:6572:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1784043984.769915:0:6572:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1784043984.778615:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6889:x1870705598672896:12345-0@lo:5: Request processed in 29027us (29335us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784043984.778632:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784043984.779047:0:6889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904beeef0000 x1870705598672896/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044000 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043984.779077:0:6889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1870705598672896:0@lo:5: 00000004:00080000:1.0:1784043984.779102:0:6889:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:2.0:1784043985.072786:0:6945:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784043985.758212:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043986.782184:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043987.807055:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043988.830245:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043989.413448:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598673280:0@lo:400: 00000100:00100000:0.0:1784043989.413522:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.413582:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784043989.413588:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598673408:0@lo:400: 00000100:00100000:0.0:1784043989.413615:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.413656:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598673280 00000100:00100000:0.0:1784043989.413664:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598673280 00000100:00100000:0.0:1784043989.413720:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784043989.413730:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598673280:12345-0@lo:400: 00000100:00100000:0.0:1784043989.413781:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598673280:12345-0@lo:400: Request processed in 52us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043989.413788:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784043989.413811:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598673408 00000100:00100000:0.0:1784043989.413815:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598673408 00000100:00100000:1.0:1784043989.413989:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598673152:0@lo:400: 00000100:00100000:1.0:1784043989.414018:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043989.414039:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784043989.414044:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598673024:0@lo:400: 00000100:00100000:1.0:1784043989.414068:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043989.414096:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598673152 00000100:00100000:1.0:1784043989.414100:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598673152 00000100:00100000:1.0:1784043989.414121:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784043989.414126:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598673152:12345-0@lo:400: 00000100:00100000:1.0:1784043989.414155:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598673152:12345-0@lo:400: Request processed in 29us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043989.414161:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784043989.414176:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598673024 00000100:00100000:1.0:1784043989.414179:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598673024 00000100:00100000:1.0:1784043989.414200:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784043989.414206:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:3289:x1870705598673024:12345-0@lo:400: 00000100:00100000:1.0:1784043989.414234:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:3289:x1870705598673024:12345-0@lo:400: Request processed in 28us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043989.414240:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784043989.414279:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598673024:0@lo:400: 00010000:00080000:1.0:1784043989.414293:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc5add880 x1870705598673152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043989.414325:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598673152:0@lo:400: 00000100:00100000:0.0:1784043989.414397:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784043989.414405:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598673408:12345-0@lo:400: 00000100:00100000:0.0:1784043989.414437:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598673408:12345-0@lo:400: Request processed in 33us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043989.414443:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1784043989.414459:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784043989.414463:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784043989.414491:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc5adc380 x1870705598673408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043989.414501:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598673408:0@lo:400: 00010000:00080000:0.0:1784043989.414511:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc5adf800 x1870705598673280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043989.414517:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598673280:0@lo:400: 00000001:00080000:2.0:1784043989.776735:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1784043989.860995:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784043989.929214:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784043989.931852:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598673536:0@lo:13: 00000100:00100000:1.0:1784043989.931955:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043989.932063:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598673536 00000100:00100000:1.0:1784043989.932073:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598673536 00000100:00100000:1.0:1784043989.932127:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043989.932136:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598673536:12345-0@lo:13: 00002000:00000024:1.0:1784043989.932181:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784043989.932242:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598673536:12345-0@lo:13: Request processed in 106us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043989.932250:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784043989.932558:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904beeef1500 x1870705598673536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043989.932569:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1784043989.932592:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598673536:0@lo:13: 00010000:00010000:1.0:1784043990.878938:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043991.903045:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043992.926335:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043993.951736:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784043994.528901:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598674048:0@lo:400: 00000100:00100000:1.0:1784043994.528985:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043994.529047:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784043994.529054:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598673664:0@lo:400: 00000100:00100000:1.0:1784043994.529082:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043994.529114:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598673792:0@lo:400: 00000100:00100000:1.0:1784043994.529139:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043994.529156:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784043994.529161:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598673920:0@lo:400: 00000100:00100000:1.0:1784043994.529180:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043994.529220:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598674048 00000100:00100000:1.0:1784043994.529235:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598674048 00000100:00100000:1.0:1784043994.529304:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043994.529313:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598674048:12345-0@lo:400: 00000100:00100000:1.0:1784043994.529364:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598674048:12345-0@lo:400: Request processed in 53us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043994.529373:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043994.529397:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598673664 00000100:00100000:1.0:1784043994.529400:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598673664 00000100:00100000:1.0:1784043994.529425:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784043994.529431:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:3288:x1870705598673664:12345-0@lo:400: 00000100:00100000:1.0:1784043994.529459:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:3288:x1870705598673664:12345-0@lo:400: Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043994.529466:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784043994.529492:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598673792 00000100:00100000:1.0:1784043994.529495:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598673792 00000100:00100000:1.0:1784043994.529516:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598673920 00000100:00100000:1.0:1784043994.529519:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598673920 00000100:00100000:1.0:1784043994.529534:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784043994.529540:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598673792:12345-0@lo:400: 00000100:00100000:1.0:1784043994.529572:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598673792:12345-0@lo:400: Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043994.529578:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784043994.529589:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784043994.529595:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598673920:12345-0@lo:400: 00000100:00100000:1.0:1784043994.529621:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598673920:12345-0@lo:400: Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043994.529627:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1784043994.529645:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784043994.529655:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784043994.529773:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904beeef0380 x1870705598673920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043994.529786:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598673920:0@lo:400: 00010000:00080000:1.0:1784043994.529796:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904beeef0000 x1870705598673792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043994.529804:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598673792:0@lo:400: 00000100:00100000:1.0:1784043994.529827:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598673664:0@lo:400: 00010000:00080000:1.0:1784043994.529836:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904beeef2680 x1870705598674048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043994.529844:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598674048:0@lo:400: 00000020:01000004:1.0:1784043994.888849:0:7466:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784043994.888853:0:7466:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1784043994.889135:0:7466:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff904bffcb1000 00000020:01000004:1.0:1784043994.889152:0:7466:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784043994.889165:0:7466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1784043994.889178:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff904bed5c19c0) 00000020:00000080:1.0:1784043994.889195:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784043994.920821:0:7466:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784043994.921248:0:7466:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1784043994.947803:0:7466:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784043994.952380:0:7466:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784043994.952417:0:7466:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784043994.952478:0:7466:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784043994.952520:0:7466:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784043994.952990:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1784043994.953002:0:7466:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784043994.953012:0:7466:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9cc73983a754ff0f 00000020:01000004:3.0:1784043994.953020:0:7466:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1784043994.953040:0:7466:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784043994.953043:0:7466:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784043994.953048:0:7466:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1784043994.953068:0:7466:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1784043994.953078:0:7466:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1784043994.970802:0:7466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784043994.970836:0:7466:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.150@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1784043994.970840:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784043994.970842:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784043994.970844:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043994.970845:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043994.970846:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043994.970847:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043994.970849:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784043994.970850:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043994.970851:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043994.970852:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043994.970853:0:7466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784043994.970856:0:7466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1784043994.970858:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784043994.970859:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784043994.970860:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043994.970861:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043994.970891:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043994.970893:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043994.970893:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784043994.970895:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043994.970896:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043994.970897:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043994.970898:0:7466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784043994.970924:0:7466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784043994.970984:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598674176:0@lo:253: 00000100:00100000:2.0:1784043994.971055:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043994.971117:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe180 going to sleep for 11 seconds 00000100:00100000:0.0:1784043994.971285:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598674176 00000100:00100000:0.0:1784043994.971292:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598674176 00000100:00100000:0.0:1784043994.971385:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784043994.971394:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:7466:x1870705598674176:12345-0@lo:253: 20000000:01000000:0.0:1784043994.971431:0:5762:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784043994.971435:0:5762:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1784043994.971440:0:5762:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1784043994.971443:0:5762:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1784043994.972412:0:5762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784043994.972605:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1784043994.972619:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1784043994.972656:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1784043994.972664:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1784043994.972696:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1784043994.972746:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1784043994.973135:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1784043994.973153:0:5762:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:0.0:1784043994.973155:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:0.0:1784043994.973201:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1784043994.973209:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784043994.973253:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1784043994.973261:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:0.0:1784043994.973290:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1784043994.973299:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1784043994.973327:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1784043994.973371:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1784043994.974119:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1784043994.974137:0:5762:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:0.0:1784043994.974139:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:0.0:1784043994.974171:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1784043994.974178:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784043994.974204:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1784043994.974211:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:0.0:1784043994.974237:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1784043994.974245:0:5762:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1784043994.974288:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1784043994.974324:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1784043994.974339:0:5762:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1784043994.974342:0:5762:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1784043994.974346:0:5762:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784043994.974358:0:5762:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784043994.974360:0:5762:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784043994.974390:0:5762:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784043994.974393:0:5762:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784043994.975475:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1784043994.975553:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1784043994.975588:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1784043994.975913:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1784043994.975966:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1784043994.976014:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1784043994.976028:0:5762:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784043994.976030:0:5762:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784043994.976315:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1784043994.976421:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1784043994.976465:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1784043994.976513:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1784043994.976523:0:5762:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784043994.976525:0:5762:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784043994.977200:0:7470:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1784043994.977261:0:7470:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1784043994.977317:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1784043994.977524:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1784043994.977558:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1784043994.977606:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1784043994.977618:0:5762:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784043994.977620:0:5762:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784043994.978130:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1784043994.978188:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1784043994.978242:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00010000:00010000:3.0:1784043994.978343:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784043994.978550:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1784043994.978584:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1784043994.978615:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1784043994.978630:0:5762:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1784043994.978632:0:5762:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1784043994.978640:0:5762:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784043994.978660:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.978677:0:5762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1679c00/0x9cc73983a754fe67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe60 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.978684:0:5762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1679200/0x9cc73983a754fe91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe8a expref: 16 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.978690:0:5762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc0031000/0x9cc73983a754febb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754feb4 expref: 16 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.978697:0:5762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1663600/0x9cc73983a754fed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fed0 expref: 16 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.978703:0:5762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc0031200/0x9cc73983a754ff01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fefa expref: 16 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.978710:0:5762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.978756:0:5762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc0031200/0x9cc73983a754ff01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fefa expref: 16 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.978769:0:5762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc0031200/0x9cc73983a754ff01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fefa expref: 16 pid: 5764 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043994.978784:0:5762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598674304:0@lo:104: 00000100:00100000:2.0:1784043994.978846:0:5762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784043994.979089:0:5762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1663600/0x9cc73983a754fed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fed0 expref: 16 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.979098:0:5762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1663600/0x9cc73983a754fed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fed0 expref: 16 pid: 5762 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043994.979107:0:5762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598674432:0@lo:104: 00010000:00010000:2.0:1784043994.979129:0:5762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc0031000/0x9cc73983a754febb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754feb4 expref: 16 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.979137:0:5762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc0031000/0x9cc73983a754febb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754feb4 expref: 16 pid: 5764 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043994.979144:0:5762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cff800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598674560:0@lo:104: 00010000:00010000:2.0:1784043994.979161:0:5762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1679200/0x9cc73983a754fe91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fe8a expref: 16 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.979169:0:5762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1679200/0x9cc73983a754fe91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fe8a expref: 16 pid: 5762 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043994.979177:0:5762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598674688:0@lo:104: 00010000:00010000:2.0:1784043994.979204:0:5762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1679c00/0x9cc73983a754fe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fe60 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043994.979211:0:5762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1679c00/0x9cc73983a754fe67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fe60 expref: 16 pid: 5763 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043994.979219:0:5762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598674816:0@lo:104: 00000100:00100000:2.0:1784043994.979232:0:5762:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe900 going to sleep for 11 seconds 00000100:00100000:1.0:1784043994.979386:0:5753:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784043994.979405:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043994.979454:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043994.979530:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043994.979578:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598674304 00000100:00100000:0.0:1784043994.979585:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598674304 00000100:00100000:0.0:1784043994.979620:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598674432 00000100:00100000:0.0:1784043994.979623:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598674432 00000100:00100000:0.0:1784043994.979633:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598674560 00000100:00100000:0.0:1784043994.979634:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598674560 00000100:00100000:0.0:1784043994.979647:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784043994.979655:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc50a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+5:5762:x1870705598674304:12345-0@lo:104: 00010000:00010000:0.0:1784043994.979668:0:5754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.979737:0:5754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784043994.979742:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc50a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+5:5762:x1870705598674304:12345-0@lo:104: Request processed in 89us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043994.979749:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784043994.979801:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784043994.979807:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:5762:x1870705598674432:12345-0@lo:104: 00010000:00010000:0.0:1784043994.979814:0:5754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.979846:0:5754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784043994.979851:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:5762:x1870705598674432:12345-0@lo:104: Request processed in 45us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043994.979856:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784043994.979903:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784043994.979910:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5762:x1870705598674560:12345-0@lo:104: 00010000:00010000:0.0:1784043994.979918:0:5754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.979965:0:5754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784043994.979971:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5762:x1870705598674560:12345-0@lo:104: Request processed in 62us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043994.979976:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1784043994.979993:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784043994.979998:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980005:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1678e00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784043994.980010:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980017:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784043994.980024:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043994.980030:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784043994.980059:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980065:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784043994.980082:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980089:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1678e00/0x9cc73983a754fefa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff01 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980113:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784043994.980116:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980121:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1678c00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784043994.980124:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980131:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784043994.980137:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043994.980142:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784043994.980156:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980161:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784043994.980173:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980179:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1678c00/0x9cc73983a754fed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fed7 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980188:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784043994.980191:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980205:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5a00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784043994.980207:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980213:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784043994.980219:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043994.980224:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784043994.980235:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980240:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784043994.980244:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980250:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f5a00/0x9cc73983a754feb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754febb expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980257:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043994.980259:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043994.980261:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043994.980280:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598674944:0@lo:103: 00000100:00100000:0.0:1784043994.980307:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043994.980337:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598675072:0@lo:103: 00000100:00100000:0.0:1784043994.980356:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043994.980378:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784043994.980398:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598675200:0@lo:103: 00000100:00100000:0.0:1784043994.980419:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043994.980447:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598674944 00000100:00100000:0.0:1784043994.980451:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598674944 00010000:00010000:0.0:1784043994.980468:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc0031200/0x9cc73983a754ff01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fefa expref: 17 pid: 5764 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043994.980481:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598675072 00000100:00100000:0.0:1784043994.980484:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598675072 00010000:00010000:0.0:1784043994.980492:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1663600/0x9cc73983a754fed7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fed0 expref: 18 pid: 5762 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043994.980499:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598675200 00000100:00100000:0.0:1784043994.980501:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598675200 00010000:00010000:0.0:1784043994.980509:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc0031000/0x9cc73983a754febb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754feb4 expref: 19 pid: 5764 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043994.980518:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784043994.980523:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598674944:12345-0@lo:103: 00010000:00010000:0.0:1784043994.980533:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784043994.980537:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc0031200/0x9cc73983a754ff01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fefa expref: 19 pid: 5764 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980547:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc0031200/0x9cc73983a754ff01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fefa expref: 19 pid: 5764 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980560:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784043994.980584:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598674944:12345-0@lo:103: Request processed in 60us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043994.980589:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784043994.980609:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784043994.980615:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:3290:x1870705598675072:12345-0@lo:103: 00010000:00010000:0.0:1784043994.980623:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784043994.980627:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1663600/0x9cc73983a754fed7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fed0 expref: 18 pid: 5762 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980635:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1663600/0x9cc73983a754fed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fed0 expref: 18 pid: 5762 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980644:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784043994.980669:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:3290:x1870705598675072:12345-0@lo:103: Request processed in 54us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043994.980675:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784043994.980685:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784043994.980691:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:3290:x1870705598675200:12345-0@lo:103: 00010000:00010000:0.0:1784043994.980698:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784043994.980702:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc0031000/0x9cc73983a754febb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754feb4 expref: 17 pid: 5764 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980709:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc0031000/0x9cc73983a754febb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754feb4 expref: 17 pid: 5764 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.980717:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784043994.980736:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:3290:x1870705598675200:12345-0@lo:103: Request processed in 46us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043994.980742:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784043994.980777:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598674944:0@lo:103: 00000100:00100000:0.0:1784043994.980798:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598675200:0@lo:103: 00000100:00100000:0.0:1784043994.980815:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598675072:0@lo:103: 00010000:00010000:3.0:1784043994.981289:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc0031200/0x9cc73983a754ff01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fefa expref: 16 pid: 5764 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043994.981302:0:5762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598674304:0@lo:104: 00010000:00010000:3.0:1784043994.981310:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1663600/0x9cc73983a754fed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fed0 expref: 15 pid: 5762 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043994.981318:0:5762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598674432:0@lo:104: 00010000:00010000:3.0:1784043994.981326:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc0031000/0x9cc73983a754febb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754feb4 expref: 14 pid: 5764 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043994.981332:0:5762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cff800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598674560:0@lo:104: 00010000:00010000:3.0:1784043994.981355:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784043994.981480:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043994.981501:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598674688 00000100:00100000:1.0:1784043994.981505:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598674688 00000100:00100000:1.0:1784043994.981530:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598674816 00000100:00100000:1.0:1784043994.981532:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598674816 00000100:00100000:1.0:1784043994.981544:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784043994.981550:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:5762:x1870705598674688:12345-0@lo:104: 00010000:00010000:1.0:1784043994.981560:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981601:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784043994.981606:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:5762:x1870705598674688:12345-0@lo:104: Request processed in 57us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043994.981613:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784043994.981626:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784043994.981631:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5762:x1870705598674816:12345-0@lo:104: 00010000:00010000:1.0:1784043994.981638:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981669:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784043994.981674:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5762:x1870705598674816:12345-0@lo:104: Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043994.981680:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1784043994.981694:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784043994.981699:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981706:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0030a00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784043994.981709:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981726:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784043994.981733:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043994.981739:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784043994.981761:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981766:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784043994.981776:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981782:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754fe8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe91 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981793:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784043994.981796:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981801:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784043994.981804:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981809:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784043994.981815:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043994.981826:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784043994.981838:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981843:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784043994.981847:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981853:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1662200/0x9cc73983a754fe60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe67 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043994.981894:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043994.981896:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043994.981898:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784043994.981914:0:5762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598674688:0@lo:104: 00000100:00100000:1.0:1784043994.981921:0:5762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5762:1870705598674816:0@lo:104: 00010000:00010000:1.0:1784043994.982031:0:5762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043994.982101:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598675328:0@lo:103: 00000100:00100000:0.0:1784043994.982134:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043994.982163:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784043994.982168:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598675456:0@lo:103: 00000100:00100000:0.0:1784043994.982188:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043994.982213:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598675328 00000100:00100000:0.0:1784043994.982217:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598675328 00010000:00010000:0.0:1784043994.982233:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1679200/0x9cc73983a754fe91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fe8a expref: 14 pid: 5762 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043994.982250:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598675456 00000100:00100000:0.0:1784043994.982253:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598675456 00010000:00010000:0.0:1784043994.982261:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1679c00/0x9cc73983a754fe67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fe60 expref: 15 pid: 5763 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043994.982271:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784043994.982277:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:3288:x1870705598675328:12345-0@lo:103: 00010000:00010000:0.0:1784043994.982285:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784043994.982289:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1679200/0x9cc73983a754fe91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fe8a expref: 15 pid: 5762 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982297:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1679200/0x9cc73983a754fe91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fe8a expref: 15 pid: 5762 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982307:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1679200/0x9cc73983a754fe91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fe8a expref: 15 pid: 5762 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982317:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784043994.982348:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:3288:x1870705598675328:12345-0@lo:103: Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043994.982355:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784043994.982367:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784043994.982372:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:3288:x1870705598675456:12345-0@lo:103: 00010000:00010000:0.0:1784043994.982378:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784043994.982382:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1679c00/0x9cc73983a754fe67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fe60 expref: 13 pid: 5763 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982391:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1679c00/0x9cc73983a754fe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fe60 expref: 13 pid: 5763 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982400:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1679c00/0x9cc73983a754fe67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fe60 expref: 13 pid: 5763 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982410:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982418:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982432:0:5757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982439:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982445:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982451:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982461:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784043994.982465:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982473:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982484:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982493:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784043994.982512:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3288:x1870705598675456:12345-0@lo:103: Request processed in 140us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043994.982518:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784043994.982549:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598675456:0@lo:103: 00000100:00100000:0.0:1784043994.982556:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598675328:0@lo:103: 00010000:00010000:0.0:1784043994.982573:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043994.982579:0:5762:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982586:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043994.982591:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f5000/0x9cc73983a754ff16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784043994.982604:0:5762:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1784043995.015287:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:7466:x1870705598674176:12345-0@lo:253: Request processed in 43886us (44224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.015301:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784043995.015396:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598674176:0@lo:253: 10000000:01000000:0.0:1784043995.015423:0:7466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784043995.015426:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784043995.015428:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784043995.015429:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784043995.015430:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1784043995.015431:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784043995.015432:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784043995.015434:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784043995.015435:0:7466:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784043995.015437:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784043995.015438:0:7466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784043995.015459:0:7466:0:(tgt_mount.c:101:server_register_mount()) register mount ffff904bffcb1000 from lustre-OST0001 10000000:01000000:0.0:1784043995.015484:0:7466:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1784043995.015487:0:7466:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784043995.015494:0:7466:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff904bd40e4d40 local copy 10000000:01000000:0.0:1784043995.015498:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784043995.015533:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.015543:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.015552:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043995.015569:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5addf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598675584:0@lo:101: 00000100:00100000:0.0:1784043995.015602:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.015643:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc52d4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784043995.015825:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598675584 00000100:00100000:3.0:1784043995.015832:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598675584 00000100:00100000:3.0:1784043995.015905:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784043995.015915:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:7466:x1870705598675584:12345-0@lo:101: 00010000:00010000:3.0:1784043995.015927:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043995.016063:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1679800/0x9cc73983a754ff24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754ff1d expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.016088:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1679800/0x9cc73983a754ff24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754ff1d expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.016109:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1679800/0x9cc73983a754ff24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff1d expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.016117:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1679800, rc 0) 00000100:00100000:3.0:1784043995.018137:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598675584:12345-0@lo:101: Request processed in 2215us (2526us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.018151:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784043995.019306:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5addf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598675584:0@lo:101: 00010000:00010000:0.0:1784043995.019332:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.019363:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043995.019491:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5addf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598675712:0@lo:501: 00000100:00100000:0.0:1784043995.019546:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.019583:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc52d4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784043995.019778:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598675712 00000100:00100000:3.0:1784043995.019785:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598675712 00000100:00100000:3.0:1784043995.019832:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784043995.019841:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598675712:12345-0@lo:501: 00000100:00100000:3.0:1784043995.020474:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598675712:12345-0@lo:501: Request processed in 633us (925us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784043995.020483:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784043995.020561:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5addf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598675712:0@lo:501: 10000000:01000000:0.0:1784043995.020576:0:7466:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784043995.020764:0:7466:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784043995.020771:0:7466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.020779:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.020786:0:7466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.020811:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784043995.020834:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff904bffcb1000 10000000:01000000:0.0:1784043995.020840:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784043995.020845:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784043995.020848:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784043995.020853:0:7466:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1784043995.020855:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784043995.020917:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784043995.020918:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.020924:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.020936:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.020946:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043995.020961:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5addf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598675840:0@lo:101: 00000100:00100000:0.0:1784043995.020993:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784043995.021008:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0030a00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784043995.021012:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.021019:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043995.021023:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc52d46c0 going to sleep for 11 seconds 10000000:00010000:1.0:1784043995.021032:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043995.021039:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784043995.021060:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.021067:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784043995.021108:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.021117:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc0030a00/0x9cc73983a754ff1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9cc73983a754ff24 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043995.021127:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598675968:0@lo:103: 00010000:00010000:1.0:1784043995.021131:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043995.021133:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043995.021135:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043995.021160:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043995.021225:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598675968 00000100:00100000:1.0:1784043995.021231:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598675968 00000100:00100000:1.0:1784043995.021268:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043995.021276:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3290:x1870705598675968:12345-0@lo:103: 00010000:00010000:1.0:1784043995.021287:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784043995.021299:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1679800/0x9cc73983a754ff24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a754ff1d expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.021314:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784043995.021341:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:3290:x1870705598675968:12345-0@lo:103: Request processed in 65us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043995.021348:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784043995.021381:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598675968:0@lo:103: 00000100:00100000:3.0:1784043995.021462:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598675840 00000100:00100000:3.0:1784043995.021466:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598675840 00000100:00100000:3.0:1784043995.021501:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784043995.021508:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+11:7466:x1870705598675840:12345-0@lo:101: 00010000:00010000:3.0:1784043995.021518:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043995.021529:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1678200/0x9cc73983a754ff32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754ff2b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.021546:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1678200/0x9cc73983a754ff32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754ff2b expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.021556:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1678200/0x9cc73983a754ff32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff2b expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.021573:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1678200, rc 0) 00000100:00100000:3.0:1784043995.021655:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598675840:12345-0@lo:101: Request processed in 147us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.021661:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784043995.021765:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5addf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598675840:0@lo:101: 00010000:00010000:2.0:1784043995.021778:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043995.021786:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043995.021858:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676096:0@lo:501: 00000100:00100000:2.0:1784043995.022034:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.022159:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe180 going to sleep for 11 seconds 00000100:00100000:3.0:1784043995.022200:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598676096 00000100:00100000:3.0:1784043995.022204:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598676096 00000100:00100000:3.0:1784043995.022528:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784043995.022536:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598676096:12345-0@lo:501: 00000100:00100000:3.0:1784043995.022757:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598676096:12345-0@lo:501: Request processed in 221us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.022764:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784043995.022838:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676096:0@lo:501: 00000100:00100000:2.0:1784043995.022904:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676224:0@lo:503: 00000100:00100000:2.0:1784043995.022954:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.023252:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe180 going to sleep for 11 seconds 00000100:00100000:1.0:1784043995.023329:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598676224 00000100:00100000:1.0:1784043995.023335:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598676224 00000100:00100000:1.0:1784043995.023362:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784043995.023369:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598676224:12345-0@lo:503: 00000100:00100000:1.0:1784043995.023560:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598676224:12345-0@lo:503: Request processed in 191us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043995.023567:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784043995.023673:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676224:0@lo:503: 00000040:00080000:2.0:1784043995.024216:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784043995.024282:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676352:0@lo:502: 00000100:00100000:2.0:1784043995.024326:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.024400:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe180 going to sleep for 11 seconds 00000100:00100000:1.0:1784043995.024444:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598676352 00000100:00100000:1.0:1784043995.024449:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598676352 00000100:00100000:1.0:1784043995.024526:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784043995.024535:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598676352:12345-0@lo:502: 00000100:00100000:1.0:1784043995.024687:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598676352:12345-0@lo:502: Request processed in 152us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043995.024694:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784043995.024764:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676352:0@lo:502: 00000040:00080000:2.0:1784043995.025056:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784043995.025122:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1784043995.025156:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1784043995.025205:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1784043995.025243:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1784043995.025275:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1784043995.025300:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676480:0@lo:502: 00000100:00100000:2.0:1784043995.025337:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.025726:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe180 going to sleep for 11 seconds 00000100:00100000:3.0:1784043995.025811:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598676480 00000100:00100000:3.0:1784043995.025818:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598676480 00000100:00100000:3.0:1784043995.025848:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784043995.025856:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598676480:12345-0@lo:502: 00000100:00100000:3.0:1784043995.026108:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598676480:12345-0@lo:502: Request processed in 252us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.026116:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784043995.026218:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676480:0@lo:502: 00000040:00080000:2.0:1784043995.026316:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1784043995.026327:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1784043995.026799:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784043995.026807:0:7474:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1784043995.026813:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043995.026815:0:7474:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1784043995.026821:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784043995.026845:0:7474:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff904bf5af8000) 00000020:00000080:2.0:1784043995.026900:0:7474:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784043995.026908:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784043995.026982:0:7474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904bffcb1000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1784043995.026990:0:7474:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784043995.026996:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9cc73983a754ff40 00010000:00010000:2.0:1784043995.030387:0:7474:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1784043995.030658:0:7474:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1784043995.033576:0:7474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1784043995.033846:0:7474:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1784043995.039723:0:7474:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784043995.040465:0:7474:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000100:00100000:3.0:1784043995.041074:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784043995.041094:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598676608:0@lo:13: 00000100:00100000:3.0:1784043995.041161:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043995.041412:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598676608 00000100:00100000:1.0:1784043995.041419:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598676608 00000100:00100000:1.0:1784043995.041464:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784043995.041472:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598676608:12345-0@lo:13: 00002000:00000024:1.0:1784043995.041503:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784043995.041554:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598676608:12345-0@lo:13: Request processed in 83us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043995.041561:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784043995.041676:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904beeef0e00 x1870705598676608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784043995.041695:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598676608:0@lo:13: 00000020:00000080:2.0:1784043995.042729:0:7474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1784043995.042739:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784043995.042745:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043995.042747:0:7474:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1784043995.042750:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784043995.042754:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043995.042756:0:7474:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784043995.042758:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784043995.042760:0:7474:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784043995.042812:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784043995.042817:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043995.042818:0:7474:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784043995.042821:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784043995.046172:0:7466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1784043995.046217:0:7466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784043995.046236:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.046248:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043995.046257:0:7466:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bffcb1000 from 1 10000000:01000000:3.0:1784043995.046259:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784043995.046295:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.046303:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.046313:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043995.046335:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676736:0@lo:101: 00000100:00100000:3.0:1784043995.046393:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043995.046438:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5078cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043995.046503:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598676736 00000100:00100000:2.0:1784043995.046510:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598676736 00000100:00100000:2.0:1784043995.046558:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784043995.046566:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:7466:x1870705598676736:12345-0@lo:101: 00010000:00010000:2.0:1784043995.046578:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043995.046590:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f4a00/0x9cc73983a754ff4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754ff47 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043995.046611:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f4a00/0x9cc73983a754ff4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754ff47 expref: 13 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043995.046621:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f4a00/0x9cc73983a754ff4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff47 expref: 13 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043995.046629:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4a00, rc 0) 00000100:00100000:2.0:1784043995.046670:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598676736:12345-0@lo:101: Request processed in 105us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.046686:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784043995.046731:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676736:0@lo:101: 00010000:00010000:2.0:1784043995.046746:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043995.046754:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043995.046846:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676864:0@lo:501: 00000100:00100000:2.0:1784043995.046924:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.047151:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe480 going to sleep for 11 seconds 00000100:00100000:3.0:1784043995.047198:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598676864 00000100:00100000:3.0:1784043995.047202:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598676864 00000100:00100000:3.0:1784043995.047234:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784043995.047241:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598676864:12345-0@lo:501: 00000100:00100000:3.0:1784043995.047444:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598676864:12345-0@lo:501: Request processed in 202us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.047451:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784043995.047525:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676864:0@lo:501: 00000100:00100000:2.0:1784043995.047553:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676992:0@lo:503: 00000100:00100000:2.0:1784043995.047588:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.047607:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe480 going to sleep for 11 seconds 00000100:00100000:0.0:1784043995.047651:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598676992 00000100:00100000:0.0:1784043995.047656:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598676992 00000100:00100000:0.0:1784043995.047688:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784043995.047695:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598676992:12345-0@lo:503: 00000100:00100000:0.0:1784043995.048287:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598676992:12345-0@lo:503: Request processed in 591us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043995.048295:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784043995.052121:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598676992:0@lo:503: 00000040:00080000:2.0:1784043995.052447:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784043995.052523:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677120:0@lo:502: 00000100:00100000:2.0:1784043995.052594:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.052679:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe480 going to sleep for 11 seconds 00000100:00100000:0.0:1784043995.052778:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598677120 00000100:00100000:0.0:1784043995.052785:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598677120 00000100:00100000:0.0:1784043995.052905:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784043995.052914:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598677120:12345-0@lo:502: 00000100:00100000:0.0:1784043995.053397:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598677120:12345-0@lo:502: Request processed in 483us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043995.053404:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784043995.053517:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677120:0@lo:502: 00000040:00080000:2.0:1784043995.053783:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1784043995.053832:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1784043995.054366:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677248:0@lo:502: 00000100:00100000:2.0:1784043995.054414:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.054452:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe480 going to sleep for 11 seconds 00000100:00100000:0.0:1784043995.054497:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598677248 00000100:00100000:0.0:1784043995.054503:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598677248 00000100:00100000:0.0:1784043995.054544:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784043995.054552:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598677248:12345-0@lo:502: 00000100:00100000:0.0:1784043995.054699:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598677248:12345-0@lo:502: Request processed in 147us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043995.054706:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784043995.054776:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677248:0@lo:502: 00000040:00080000:2.0:1784043995.054860:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1784043995.054910:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1784043995.055453:0:7478:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784043995.055461:0:7478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043995.055463:0:7478:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784043995.055469:0:7478:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904bffcb1000 00000020:00000080:2.0:1784043995.055471:0:7478:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784043995.055486:0:7478:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784043995.055489:0:7478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043995.055490:0:7478:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784043995.055493:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1784043995.055599:0:7466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784043995.055617:0:7466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784043995.055637:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.055648:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043995.055687:0:7466:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784043995.055690:0:7466:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff904bffcb1000 10000000:01000000:0.0:1784043995.055693:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff904bffcb1000 10000000:01000000:0.0:1784043995.055697:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784043995.055702:0:7466:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904bffcb1000 from 1 10000000:01000000:0.0:1784043995.055704:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784043995.055732:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.055739:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.055748:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043995.055766:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677376:0@lo:101: 00000100:00100000:0.0:1784043995.055808:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.055835:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598677376 00000100:00100000:0.0:1784043995.055840:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598677376 00000100:00100000:0.0:1784043995.056072:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784043995.056081:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598677376:12345-0@lo:101: 00010000:00010000:0.0:1784043995.056093:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043995.056106:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc0031400/0x9cc73983a754ff5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754ff55 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.056127:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc0031400/0x9cc73983a754ff5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754ff55 expref: 14 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.056136:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc0031400/0x9cc73983a754ff5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff55 expref: 14 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.056144:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031400, rc 0) 00000100:00100000:0.0:1784043995.056172:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7466:x1870705598677376:12345-0@lo:101: Request processed in 92us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043995.056178:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784043995.056215:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc67c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784043995.056231:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677376:0@lo:101: 00010000:00010000:0.0:1784043995.056243:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.056252:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043995.056321:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677504:0@lo:501: 00000100:00100000:0.0:1784043995.056354:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.056418:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc67c20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043995.056569:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598677504 00000100:00100000:2.0:1784043995.056574:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598677504 00000100:00100000:2.0:1784043995.056635:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784043995.056643:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7466:x1870705598677504:12345-0@lo:501: 00000100:00100000:2.0:1784043995.056852:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7466:x1870705598677504:12345-0@lo:501: Request processed in 210us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.056859:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784043995.057240:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677504:0@lo:501: 00000100:00100000:0.0:1784043995.057273:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677632:0@lo:503: 00000100:00100000:0.0:1784043995.057310:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.057341:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc67c20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043995.057384:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598677632 00000100:00100000:2.0:1784043995.057388:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598677632 00000100:00100000:2.0:1784043995.057449:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784043995.057457:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7466:x1870705598677632:12345-0@lo:503: 00000100:00100000:2.0:1784043995.057607:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7466:x1870705598677632:12345-0@lo:503: Request processed in 151us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.057614:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784043995.057674:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677632:0@lo:503: 00000040:00080000:0.0:1784043995.058056:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784043995.058113:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677760:0@lo:502: 00000100:00100000:0.0:1784043995.058148:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.058469:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc67c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784043995.058531:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598677760 00000100:00100000:1.0:1784043995.058536:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598677760 00000100:00100000:1.0:1784043995.058560:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784043995.058569:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7466:x1870705598677760:12345-0@lo:502: 00000100:00100000:1.0:1784043995.058757:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7466:x1870705598677760:12345-0@lo:502: Request processed in 188us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043995.058771:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784043995.058842:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677760:0@lo:502: 00000040:00080000:0.0:1784043995.059265:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784043995.059311:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784043995.059342:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784043995.059381:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784043995.059417:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784043995.059457:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784043995.059491:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784043995.059527:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784043995.059589:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784043995.059628:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784043995.059662:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784043995.059712:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784043995.059748:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784043995.059792:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784043995.059837:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784043995.060229:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784043995.060280:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784043995.060329:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784043995.060363:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784043995.060395:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784043995.060451:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784043995.060489:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784043995.060522:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784043995.060567:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784043995.060605:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1784043995.060639:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1784043995.060685:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1784043995.060722:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1784043995.060757:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1784043995.060824:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1784043995.060858:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1784043995.061051:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1784043995.061083:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1784043995.061125:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1784043995.061156:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1784043995.061197:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1784043995.061226:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1784043995.061268:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677888:0@lo:502: 00000100:00100000:0.0:1784043995.061334:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.061374:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc67c20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784043995.061446:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598677888 00000100:00100000:3.0:1784043995.061455:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598677888 00000100:00100000:3.0:1784043995.061524:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784043995.061532:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7466:x1870705598677888:12345-0@lo:502: 00000100:00100000:3.0:1784043995.061738:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7466:x1870705598677888:12345-0@lo:502: Request processed in 206us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.061746:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784043995.062026:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598677888:0@lo:502: 00000040:00080000:0.0:1784043995.062099:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1784043995.062111:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1784043995.062764:0:7479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784043995.062779:0:7479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff904bf5afb380) 00000020:00000080:2.0:1784043995.062806:0:7479:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1784043995.063563:0:7479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904bffcb1000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784043995.063568:0:7479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff904bffcb1000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784043995.063571:0:7479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904bffcb1000 3 00010000:00080000:2.0:1784043995.063599:0:7479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff904bfb3aa800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1784043995.065709:0:7479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1784043995.065816:0:7479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784043995.065854:0:7479:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784043995.067263:0:7479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9cc73983a754ff6a 00000100:00080000:2.0:1784043995.067277:0:7479:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784043995.067283:0:7479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff904bfb3aa800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1784043995.068244:0:7479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bc4cfe680 x1870705598678016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784043995.068311:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1870705598678016:0@lo:38: 00000100:00100000:1.0:1784043995.068387:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043995.068486:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598678016 00000100:00100000:3.0:1784043995.068494:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598678016 00000100:00100000:3.0:1784043995.068539:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784043995.068546:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3287:x1870705598678016:12345-0@lo:38: 00010000:00080000:3.0:1784043995.068572:0:5771:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1784043995.068603:0:5771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9cc73983a754ff71 00000004:00100000:3.0:1784043995.068618:0:5771:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784043995.068647:0:5771:0:(import.c:65:import_set_state_nolock()) ffff904bff99a000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1784043995.069222:0:7479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784043995.071230:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598678144:0@lo:400: 00000100:00100000:0.0:1784043995.071293:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.071332:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784043995.071346:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598678272:0@lo:400: 00000100:00100000:0.0:1784043995.071371:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.071398:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784043995.071406:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000040:00080000:0.0:1784043995.071658:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1784043995.071755:0:7466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1784043995.071787:0:7466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784043995.071809:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043995.071820:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784043995.072479:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784043995.072483:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784043995.072484:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784043995.072485:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784043995.072486:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784043995.072488:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784043995.072489:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784043995.072491:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784043995.072492:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784043995.072493:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784043995.072494:0:7466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784043995.072498:0:7466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1784043995.072501:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784043995.072502:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784043995.072503:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784043995.072504:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784043995.072505:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784043995.072506:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784043995.072507:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784043995.072508:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784043995.072509:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784043995.072510:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784043995.072511:0:7466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784043995.072734:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598678144 00000100:00100000:0.0:1784043995.072742:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598678144 00000100:00100000:0.0:1784043995.072785:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784043995.072792:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598678272 00000100:00100000:0.0:1784043995.072794:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598678272 00000100:00100000:0.0:1784043995.072806:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784043995.072814:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784043995.072823:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598678144:12345-0@lo:400: 00000100:00100000:0.0:1784043995.072938:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598678144:12345-0@lo:400: Request processed in 106us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043995.072947:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784043995.072959:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784043995.072965:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784043995.072971:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598678272:12345-0@lo:400: 00000100:00100000:0.0:1784043995.073000:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598678272:12345-0@lo:400: Request processed in 29us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043995.073006:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1784043995.073039:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc5adca80 x1870705598678272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043995.073053:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598678272:0@lo:400: 00010000:00080000:0.0:1784043995.073062:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc5adc000 x1870705598678144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043995.073069:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598678144:0@lo:400: 10000000:01000000:0.0:1784043995.073107:0:7466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784043995.073120:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598678400:0@lo:253: 00000100:00100000:0.0:1784043995.073154:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.073182:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5a62a80 going to sleep for 11 seconds 00000100:00080000:0.0:1784043995.073237:0:7481:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff904bc5adca80 x1870705598678528/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043995.073245:0:7481:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be0317c00 going to sleep for 0 seconds 00000100:00100000:2.0:1784043995.074933:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598678400 00000100:00100000:2.0:1784043995.074945:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598678400 00000100:00100000:2.0:1784043995.074991:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784043995.075000:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7466:x1870705598678400:12345-0@lo:253: 20000000:01000000:2.0:1784043995.075031:0:5764:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784043995.075044:0:5764:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784043995.076352:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870705598678016:12345-0@lo:38: Request processed in 7800us (7960us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.076364:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784043995.078082:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc4cfe680 x1870705598678016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043995.078096:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784043995.078106:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1784043995.078115:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784043995.078121:0:3287:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784043995.078125:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bfb3aa800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1784043995.078133:0:3287:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007c10650d): req@ffff904bc5adca80 x1870705598678528/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043995.078154:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1870705598678016:0@lo:38: 00000100:00100000:0.0:1784043995.079241:0:7481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.079269:0:7481:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be0317c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784043995.079358:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598678528 00000100:00100000:1.0:1784043995.079365:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598678528 00000100:00100000:1.0:1784043995.079427:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043995.079436:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7481:x1870705598678528:12345-0@lo:901: 00000100:00100000:1.0:1784043995.079770:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7481:x1870705598678528:12345-0@lo:901: Request processed in 335us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043995.079778:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784043995.079834:0:7481:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bc5adca80 x1870705598678528/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043995.079847:0:7481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7481:1870705598678528:0@lo:901: 00000100:00080000:0.0:1784043995.080731:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1784043995.105128:0:5764:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784043995.105150:0:5764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784043995.105210:0:5785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784043995.105215:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784043995.105249:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.105266:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1662e00/0x9cc73983a754fec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fec2 expref: 14 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.105274:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.105312:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1662e00/0x9cc73983a754fec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fec2 expref: 14 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.105326:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1662e00/0x9cc73983a754fec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fec2 expref: 14 pid: 5763 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043995.105341:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1870705598678656:0@lo:104: 00000100:00100000:1.0:1784043995.105418:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043995.105470:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff56cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784043995.105532:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598678656 00000100:00100000:3.0:1784043995.105540:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598678656 00000100:00100000:3.0:1784043995.105595:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784043995.105604:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5785:x1870705598678656:12345-0@lo:104: 00010000:00010000:3.0:1784043995.105617:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.105672:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784043995.105679:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:5785:x1870705598678656:12345-0@lo:104: Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.105692:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1784043995.105712:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784043995.105718:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.105725:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031800 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:3.0:1784043995.105729:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.105736:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784043995.105742:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043995.105748:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784043995.105773:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.105779:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784043995.105795:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.105801:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc0031800/0x9cc73983a754fec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fec9 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043995.105817:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043995.105819:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043995.105820:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784043995.105839:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598678784:0@lo:103: 00000100:00100000:3.0:1784043995.105922:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043995.106113:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1870705598678656:0@lo:104: 00010000:00010000:3.0:1784043995.106133:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043995.106187:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598678784 00000100:00100000:1.0:1784043995.106191:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598678784 00010000:00010000:1.0:1784043995.106211:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1662e00/0x9cc73983a754fec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fec2 expref: 15 pid: 5763 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043995.106240:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784043995.106247:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:3290:x1870705598678784:12345-0@lo:103: 00010000:00010000:1.0:1784043995.106258:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784043995.106262:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1662e00/0x9cc73983a754fec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fec2 expref: 15 pid: 5763 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106272:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1662e00/0x9cc73983a754fec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fec2 expref: 15 pid: 5763 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106295:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1662e00/0x9cc73983a754fec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fec2 expref: 15 pid: 5763 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106307:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106315:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784043995.106326:0:5755:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003435701s 00010000:00010000:1.0:1784043995.106331:0:5755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106337:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106343:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106348:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106353:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784043995.106357:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106363:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106377:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106396:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784043995.106430:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:3290:x1870705598678784:12345-0@lo:103: Request processed in 183us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043995.106437:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784043995.106485:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598678784:0@lo:103: 00010000:00010000:1.0:1784043995.106501:0:5785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106507:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043995.106513:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1662200/0x9cc73983a754ff78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043995.117296:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:7466:x1870705598678400:12345-0@lo:253: Request processed in 42287us (44131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043995.117312:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784043995.117410:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7466:1870705598678400:0@lo:253: 10000000:01000000:1.0:1784043995.117425:0:7466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784043995.117429:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784043995.117430:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784043995.117432:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784043995.117433:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784043995.117434:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784043995.117436:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784043995.117437:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784043995.117439:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784043995.117440:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784043995.117442:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784043995.117443:0:7466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784043995.117455:0:7466:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784043995.123512:0:7466:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1784043995.123723:0:7466:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784043995.123979:0:7466:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1784043995.124164:0:7466:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784043995.124376:0:7466:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1784043995.124598:0:7466:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1784043995.126593:0:7466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1784043995.389099:0:7466:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1784043995.389108:0:7466:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1784043995.389205:0:7466:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784043995.389442:0:7466:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784043995.389461:0:7466:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784043995.389561:0:7466:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1784043996.000411:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043997.023292:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043998.048152:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043999.071054:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044000.101669:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044000.158341:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598679040:0@lo:400: 00000100:00100000:1.0:1784044000.158358:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598679296:0@lo:400: 00000100:00100000:3.0:1784044000.158442:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598678912:0@lo:400: 00000100:00100000:0.0:1784044000.159944:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044000.160015:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044000.160026:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598679168:0@lo:400: 00000100:00100000:0.0:1784044000.160201:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044000.160246:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598679040 00000100:00100000:0.0:1784044000.160253:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598679040 00000100:00100000:0.0:1784044000.160300:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598679168 00000100:00100000:0.0:1784044000.160302:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598679168 00000100:00100000:0.0:1784044000.160330:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784044000.160338:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598679040:12345-0@lo:400: 00000100:00100000:0.0:1784044000.160390:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598679040:12345-0@lo:400: Request processed in 53us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044000.160398:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784044000.160415:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044000.160421:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598679168:12345-0@lo:400: 00000100:00100000:0.0:1784044000.160447:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598679168:12345-0@lo:400: Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044000.160607:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1784044000.160631:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784044000.160663:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc5adc000 x1870705598679168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044000.160677:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598679168:0@lo:400: 00010000:00080000:0.0:1784044000.160688:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc5add500 x1870705598679040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044000.160697:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598679040:0@lo:400: 00000100:00100000:1.0:1784044000.162985:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044000.162986:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044000.163192:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598679424:0@lo:400: 00000100:00100000:3.0:1784044000.163232:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044000.163522:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598679424 00000100:00100000:1.0:1784044000.163530:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598679424 00000100:00100000:1.0:1784044000.163586:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044000.163594:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598679424:12345-0@lo:400: 00000100:00100000:1.0:1784044000.163643:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598679424:12345-0@lo:400: Request processed in 50us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044000.163650:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1784044000.163671:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc5adf480 x1870705598679424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044000.163685:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598679424:0@lo:400: 00000100:00100000:0.0:1784044000.164803:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598678912 00000100:00100000:0.0:1784044000.164814:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598678912 00000100:00100000:0.0:1784044000.164859:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784044000.168978:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598679296 00000100:00100000:1.0:1784044000.168993:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598679296 00000100:00100000:1.0:1784044000.169066:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044000.169080:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598679296:12345-0@lo:400: 00000100:00100000:1.0:1784044000.169167:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598679296:12345-0@lo:400: Request processed in 92us (6188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044000.169175:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044000.169200:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044000.169215:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598679552:0@lo:13: 00000100:00100000:1.0:1784044000.169332:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044000.169368:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598679552 00000100:00100000:1.0:1784044000.169372:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598679552 00000100:00100000:1.0:1784044000.169402:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044000.169409:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598679552:12345-0@lo:13: 00002000:00000024:1.0:1784044000.169444:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044000.169480:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598679552:12345-0@lo:13: Request processed in 70us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044000.169486:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784044000.169518:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bed283b80 x1870705598679552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044000.169538:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598679552:0@lo:13: 00010000:00080000:1.0:1784044000.169570:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc5adc380 x1870705598679296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044000.169578:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598679296:0@lo:400: 00000100:00080000:0.0:1784044000.170613:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044000.170619:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044000.170641:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:3291:x1870705598678912:12345-0@lo:400: 00000100:00100000:0.0:1784044000.170698:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:3291:x1870705598678912:12345-0@lo:400: Request processed in 147us (7711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044000.170706:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784044000.173994:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598678912:0@lo:400: 00010000:00010000:3.0:1784044001.118117:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784044001.888722:0:7823:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784044002.142262:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044003.166141:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044004.190661:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044005.214098:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044005.278473:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598679680:0@lo:400: 00000100:00100000:2.0:1784044005.278548:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044005.278622:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598680192:0@lo:400: 00000100:00100000:2.0:1784044005.278652:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044005.278692:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044005.278699:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598680064:0@lo:400: 00000100:00100000:2.0:1784044005.278726:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044005.278756:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598679808:0@lo:400: 00000100:00100000:2.0:1784044005.278786:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044005.278805:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044005.278811:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598679936:0@lo:400: 00000100:00100000:2.0:1784044005.278833:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044005.278890:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598680064 00000100:00100000:2.0:1784044005.278898:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598680064 10000000:01000000:3.0:1784044005.278925:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784044005.278930:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904beee0a000 from 30 10000000:01000000:3.0:1784044005.278934:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:2.0:1784044005.278954:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1784044005.278962:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044005.278964:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598680064:12345-0@lo:400: 00010000:00010000:3.0:1784044005.278979:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.278991:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044005.279014:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598680448:0@lo:101: 00000100:00100000:2.0:1784044005.279023:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598680064:12345-0@lo:400: Request processed in 59us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044005.279031:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784044005.279056:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598680192 00000100:00100000:2.0:1784044005.279059:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598680192 00000100:00100000:3.0:1784044005.279068:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044005.279084:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598679808 00000100:00100000:2.0:1784044005.279088:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598679808 00000100:00100000:3.0:1784044005.279098:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044005.279101:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598679936 00000100:00100000:2.0:1784044005.279104:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598679936 00000100:00100000:3.0:1784044005.279122:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044005.279122:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784044005.279131:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598680192:12345-0@lo:400: 00000100:00100000:3.0:1784044005.279136:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598680320:0@lo:13: 00000100:00100000:2.0:1784044005.279172:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598680192:12345-0@lo:400: Request processed in 40us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.279179:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044005.279186:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784044005.279205:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784044005.279210:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598679808:12345-0@lo:400: 00000100:00100000:3.0:1784044005.279242:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598680320 00000100:00100000:2.0:1784044005.279243:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598679808:12345-0@lo:400: Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.279249:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598680320 00000100:00100000:2.0:1784044005.279254:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784044005.279268:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784044005.279275:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598679936:12345-0@lo:400: 00000100:00100000:3.0:1784044005.279294:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784044005.279303:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598679936:12345-0@lo:400: Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.279306:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598680320:12345-0@lo:13: 00000100:00100000:2.0:1784044005.279325:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00002000:00000024:3.0:1784044005.279337:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1784044005.279366:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc4cfe680 x1870705598680064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044005.279381:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598680320:12345-0@lo:13: Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044005.279383:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598680064:0@lo:400: 00000100:00100000:3.0:1784044005.279395:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784044005.279404:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc4cfce00 x1870705598680192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044005.279414:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598680192:0@lo:400: 00000100:00100000:1.0:1784044005.279566:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598679680 00000100:00100000:1.0:1784044005.279571:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598679680 00010000:00080000:3.0:1784044005.279642:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc4cfdc00 x1870705598679936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044005.279729:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598680448 00000100:00100000:1.0:1784044005.279733:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598680448 00000100:00100000:1.0:1784044005.279747:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784044005.279753:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:3289:x1870705598679680:12345-0@lo:400: 00000100:00100000:1.0:1784044005.279791:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:3289:x1870705598679680:12345-0@lo:400: Request processed in 38us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.279797:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784044005.279880:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784044005.279889:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598680448:12345-0@lo:101: 00010000:00010000:1.0:1784044005.279897:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044005.279911:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1662c00/0x9cc73983a754ff86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754ff7f expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.279943:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1662c00/0x9cc73983a754ff86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754ff7f expref: 14 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044005.279951:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598679936:0@lo:400: 00010000:00010000:1.0:1784044005.279959:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1662c00/0x9cc73983a754ff86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff7f expref: 14 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.279971:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662c00, rc 0) 00010000:00080000:3.0:1784044005.279972:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc4cff100 x1870705598679808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044005.279983:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598679808:0@lo:400: 00000100:00100000:1.0:1784044005.280008:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598680448:12345-0@lo:101: Request processed in 120us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.280016:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1784044005.280021:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bed282d80 x1870705598680320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044005.280036:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598680320:0@lo:13: 00000100:00100000:3.0:1784044005.280082:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598680448:0@lo:101: 00010000:00010000:3.0:1784044005.280106:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.280114:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044005.280165:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598680576:0@lo:501: 00000100:00100000:3.0:1784044005.280193:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.280222:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044005.280291:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598680576 00000100:00100000:1.0:1784044005.280295:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598680576 00000100:00100000:1.0:1784044005.280313:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784044005.280319:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598680576:12345-0@lo:501: 00000100:00100000:1.0:1784044005.280625:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598680576:12345-0@lo:501: Request processed in 304us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.280632:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1784044005.280807:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044005.280813:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044005.281338:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598679680:0@lo:400: 00000100:00100000:3.0:1784044005.281417:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598680576:0@lo:501: 00000100:00100000:3.0:1784044005.281447:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598680704:0@lo:503: 00000100:00100000:3.0:1784044005.281490:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.281519:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044005.281565:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598680704 00000100:00100000:1.0:1784044005.281570:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598680704 00000100:00100000:1.0:1784044005.281607:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784044005.281615:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598680704:12345-0@lo:503: 00000100:00100000:1.0:1784044005.281927:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598680704:12345-0@lo:503: Request processed in 313us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.281935:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784044005.282252:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598680704:0@lo:503: 00000100:00100000:0.0:1784044005.282743:0:7958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5add500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7958:1870705598680832:0@lo:502: 00000100:00100000:0.0:1784044005.282793:0:7958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.282828:0:7958:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd074f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044005.282893:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598680832 00000100:00100000:2.0:1784044005.282898:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598680832 00000100:00100000:2.0:1784044005.282930:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784044005.282939:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7958:x1870705598680832:12345-0@lo:502: 00000100:00100000:2.0:1784044005.283201:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7958:x1870705598680832:12345-0@lo:502: Request processed in 262us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044005.283208:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784044005.283366:0:7958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5add500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7958:1870705598680832:0@lo:502: 00000100:00100000:0.0:1784044005.283408:0:7958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5add500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7958:1870705598680960:0@lo:502: 00000100:00100000:0.0:1784044005.283442:0:7958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.283465:0:7958:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd074f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044005.283509:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598680960 00000100:00100000:2.0:1784044005.283518:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598680960 00000100:00100000:2.0:1784044005.283549:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784044005.283556:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7958:x1870705598680960:12345-0@lo:502: 00000100:00100000:2.0:1784044005.283748:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:7958:x1870705598680960:12345-0@lo:502: Request processed in 191us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044005.283755:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784044005.287531:0:7958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5add500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7958:1870705598680960:0@lo:502: 00000040:00080000:1.0:1784044005.287577:0:7958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1784044005.287789:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1784044005.287811:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784044005.287822:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.287834:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044005.287844:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784044005.287847:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1784044005.287850:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784044005.288082:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.288101:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.288110:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044005.288130:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681088:0@lo:101: 00000100:00100000:3.0:1784044005.288191:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.288261:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044005.288306:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598681088 00000100:00100000:1.0:1784044005.288312:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598681088 00000100:00100000:1.0:1784044005.292537:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784044005.292557:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598681088:12345-0@lo:101: 00010000:00010000:1.0:1784044005.292576:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044005.292594:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1662e00/0x9cc73983a754ff94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754ff8d expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.292622:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1662e00/0x9cc73983a754ff94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754ff8d expref: 15 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.292690:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1662e00/0x9cc73983a754ff94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff8d expref: 15 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.292699:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662e00, rc 0) 00000100:00100000:1.0:1784044005.293273:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598681088:12345-0@lo:101: Request processed in 720us (5080us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.293281:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784044005.296255:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681088:0@lo:101: 00010000:00010000:3.0:1784044005.296354:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.296369:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044005.296525:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681216:0@lo:501: 00000100:00100000:3.0:1784044005.296662:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.296727:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.296759:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598681216 00000100:00100000:3.0:1784044005.296765:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598681216 00000100:00100000:3.0:1784044005.296819:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784044005.296837:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598681216:12345-0@lo:501: 00000100:00100000:3.0:1784044005.297427:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598681216:12345-0@lo:501: Request processed in 597us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.297436:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784044005.297493:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681216:0@lo:501: 00000100:00100000:3.0:1784044005.297524:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681344:0@lo:503: 00000100:00100000:3.0:1784044005.297576:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.297594:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.297611:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598681344 00000100:00100000:3.0:1784044005.297615:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598681344 00000100:00100000:3.0:1784044005.297645:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784044005.297654:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598681344:12345-0@lo:503: 00000100:00100000:3.0:1784044005.298030:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598681344:12345-0@lo:503: Request processed in 377us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.298037:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784044005.298168:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681344:0@lo:503: 00000100:00100000:0.0:1784044005.299357:0:7960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7960:1870705598681472:0@lo:502: 00000100:00100000:0.0:1784044005.299424:0:7960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.299468:0:7960:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd074ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.299531:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598681472 00000100:00100000:3.0:1784044005.299538:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598681472 00000100:00100000:3.0:1784044005.299586:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784044005.299595:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:7960:x1870705598681472:12345-0@lo:502: 00000100:00100000:3.0:1784044005.299847:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:7960:x1870705598681472:12345-0@lo:502: Request processed in 253us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.299855:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784044005.299987:0:7960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7960:1870705598681472:0@lo:502: 00000020:01000000:0.0:1784044005.300013:0:7960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044005.300030:0:7960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044005.300033:0:7960:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784044005.300038:0:7960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784044005.300040:0:7960:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784044005.300058:0:7960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7960:1870705598681600:0@lo:502: 00000100:00100000:0.0:1784044005.300092:0:7960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.300118:0:7960:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd074ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.300279:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598681600 00000100:00100000:3.0:1784044005.300283:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598681600 00000100:00100000:3.0:1784044005.300353:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784044005.300361:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:7960:x1870705598681600:12345-0@lo:502: 00000100:00100000:3.0:1784044005.300493:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:7960:x1870705598681600:12345-0@lo:502: Request processed in 132us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.300500:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784044005.301009:0:7960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7960:1870705598681600:0@lo:502: 00000020:01000000:1.0:1784044005.301035:0:7960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044005.301041:0:7960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044005.301043:0:7960:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784044005.301048:0:7960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1784044005.301353:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1784044005.301372:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784044005.301389:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.301399:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044005.301409:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784044005.301412:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904bc9af1000 from 30 10000000:01000000:3.0:1784044005.301415:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784044005.301444:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.301453:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.301462:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044005.301478:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681728:0@lo:101: 00000100:00100000:3.0:1784044005.301516:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.301561:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044005.301669:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598681728 00000100:00100000:1.0:1784044005.301685:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598681728 00000100:00100000:1.0:1784044005.301731:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784044005.301739:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598681728:12345-0@lo:101: 00010000:00010000:1.0:1784044005.301750:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044005.301765:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1662200/0x9cc73983a754ffa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754ff9b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.301795:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1662200/0x9cc73983a754ffa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754ff9b expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.301805:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1662200/0x9cc73983a754ffa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff9b expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.301815:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662200, rc 0) 00000100:00100000:1.0:1784044005.301851:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598681728:12345-0@lo:101: Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.301857:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784044005.302057:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681728:0@lo:101: 00010000:00010000:3.0:1784044005.302070:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.302079:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044005.302123:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681856:0@lo:501: 00000100:00100000:3.0:1784044005.302157:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.302185:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044005.302235:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598681856 00000100:00100000:1.0:1784044005.302240:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598681856 00000100:00100000:1.0:1784044005.302272:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784044005.302280:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598681856:12345-0@lo:501: 00000100:00100000:3.0:1784044005.302635:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681856:0@lo:501: 00000100:00100000:3.0:1784044005.302668:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681984:0@lo:503: 00000100:00100000:3.0:1784044005.302718:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.302733:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.302750:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598681984 00000100:00100000:3.0:1784044005.302754:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598681984 00000100:00100000:3.0:1784044005.302776:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784044005.302783:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598681984:12345-0@lo:503: 00000100:00100000:3.0:1784044005.303216:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598681984:12345-0@lo:503: Request processed in 431us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.303224:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784044005.303267:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598681984:0@lo:503: 00000100:00100000:3.0:1784044005.303439:0:7961:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7961:1870705598682112:0@lo:502: 00000100:00100000:3.0:1784044005.303473:0:7961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.303494:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598682112 00000100:00100000:3.0:1784044005.303498:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598682112 00000100:00100000:3.0:1784044005.303770:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784044005.303780:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:7961:x1870705598682112:12345-0@lo:502: 00000100:00100000:3.0:1784044005.305101:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:7961:x1870705598682112:12345-0@lo:502: Request processed in 1317us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.305112:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784044005.305166:0:7961:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5074240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.305186:0:7961:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7961:1870705598682112:0@lo:502: 00000100:00100000:3.0:1784044005.305250:0:7961:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7961:1870705598682240:0@lo:502: 00000100:00100000:3.0:1784044005.305286:0:7961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.305311:0:7961:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5074240 going to sleep for 11 seconds 00000100:00100000:2.0:1784044005.305344:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598682240 00000100:00100000:1.0:1784044005.305402:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598681856:12345-0@lo:501: Request processed in 3121us (3242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044005.305411:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598682240 00000100:00100000:1.0:1784044005.305411:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784044005.305446:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784044005.305463:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:7961:x1870705598682240:12345-0@lo:502: 00000100:00100000:1.0:1784044005.306221:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:7961:x1870705598682240:12345-0@lo:502: Request processed in 765us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.306231:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784044005.306256:0:7961:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7961:1870705598682240:0@lo:502: 00000040:00080000:2.0:1784044005.306390:0:7961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1784044005.307034:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1784044005.307057:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784044005.307068:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.307079:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044005.307089:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784044005.307092:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff904bc9af1000 from 5 10000000:01000000:3.0:1784044005.307095:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784044005.307128:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.307136:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.307146:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044005.307164:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598682368:0@lo:101: 00000100:00100000:3.0:1784044005.307204:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.307240:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5074600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044005.307258:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598682368 00000100:00100000:2.0:1784044005.307378:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598682368 00000100:00100000:2.0:1784044005.307427:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784044005.307436:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598682368:12345-0@lo:101: 00010000:00010000:2.0:1784044005.307450:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044005.307464:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f4400/0x9cc73983a754ffb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754ffa9 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044005.307494:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f4400/0x9cc73983a754ffb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754ffa9 expref: 17 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044005.307506:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f4400/0x9cc73983a754ffb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ffa9 expref: 17 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044005.307515:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4400, rc 0) 00000100:00100000:2.0:1784044005.307548:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598682368:12345-0@lo:101: Request processed in 114us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044005.307555:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784044005.308649:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598682368:0@lo:101: 00010000:00010000:0.0:1784044005.308669:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044005.308690:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044005.308753:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598682496:0@lo:256: 00000100:00100000:0.0:1784044005.308799:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.308840:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd074f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.309121:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598682496 00000100:00100000:3.0:1784044005.309127:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598682496 00000100:00100000:3.0:1784044005.309178:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784044005.309187:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598682496:12345-0@lo:256: 20000000:01000000:3.0:1784044005.309214:0:5762:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784044005.309231:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784044005.309234:0:5762:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1784044005.309663:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598682496:12345-0@lo:256: Request processed in 475us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.309671:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784044005.310046:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598682496:0@lo:256: 10000000:01000000:1.0:1784044005.310103:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044005.310112:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.310129:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044005.310139:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784044005.310141:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1784044005.310144:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784044005.310169:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.310177:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.310186:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044005.310203:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598682624:0@lo:101: 00000100:00100000:1.0:1784044005.310235:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044005.310268:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be0317c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.310609:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598682624 00000100:00100000:3.0:1784044005.310616:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598682624 00000100:00100000:3.0:1784044005.310650:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784044005.310658:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598682624:12345-0@lo:101: 00010000:00010000:3.0:1784044005.310670:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044005.310696:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1679c00/0x9cc73983a754ffbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754ffb7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.310719:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1679c00/0x9cc73983a754ffbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754ffb7 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.310730:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1679c00/0x9cc73983a754ffbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ffb7 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.310737:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1679c00, rc 0) 00000100:00100000:3.0:1784044005.310779:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598682624:12345-0@lo:101: Request processed in 122us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.310786:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784044005.311668:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598682624:0@lo:101: 00010000:00010000:1.0:1784044005.311697:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044005.311708:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044005.311777:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598682752:0@lo:501: 00000100:00100000:1.0:1784044005.311836:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044005.311900:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be0317c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.312064:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598682752 00000100:00100000:3.0:1784044005.312069:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598682752 00000100:00100000:3.0:1784044005.312111:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784044005.312122:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598682752:12345-0@lo:501: 00000100:00100000:3.0:1784044005.312404:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598682752:12345-0@lo:501: Request processed in 285us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.312419:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784044005.312698:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598682752:0@lo:501: 00000100:00100000:1.0:1784044005.312731:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598682880:0@lo:503: 00000100:00100000:1.0:1784044005.312770:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044005.312796:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be0317c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044005.312810:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598682880 00000100:00100000:1.0:1784044005.312814:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598682880 00000100:00100000:1.0:1784044005.312846:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784044005.312854:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598682880:12345-0@lo:503: 00000100:00100000:1.0:1784044005.313917:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598682880:12345-0@lo:503: Request processed in 1058us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.313928:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784044005.316769:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598682880:0@lo:503: 00000100:00100000:0.0:1784044005.317312:0:7963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7963:1870705598683008:0@lo:502: 00000100:00100000:0.0:1784044005.317390:0:7963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.317434:0:7963:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd074fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.317492:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598683008 00000100:00100000:3.0:1784044005.317500:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598683008 00000100:00100000:3.0:1784044005.317555:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784044005.317565:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:7963:x1870705598683008:12345-0@lo:502: 00000100:00100000:3.0:1784044005.317916:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:7963:x1870705598683008:12345-0@lo:502: Request processed in 352us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.317924:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784044005.318158:0:7963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7963:1870705598683008:0@lo:502: 00000020:01000000:0.0:1784044005.318184:0:7963:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784044005.318192:0:7963:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784044005.318199:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044005.318201:0:7963:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784044005.318206:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784044005.318210:0:7963:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:0.0:1784044005.318234:0:7963:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784044005.318238:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784044005.318253:0:7963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff904bff854d40) 00000020:00000080:0.0:1784044005.318277:0:7963:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1784044005.318283:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784044005.318361:0:7963:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784044005.318366:0:7963:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784044005.318373:0:7963:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a754ffcc 00010000:00080000:0.0:1784044005.318402:0:7963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff904bff66f000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:0.0:1784044005.318644:0:7963:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1784044005.319166:0:7963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1784044005.319179:0:7963:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784044005.320286:0:7963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784044005.320839:0:7963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784044005.321109:0:7963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1784044005.321170:0:7963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1784044005.324612:0:7964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044005.324625:0:7964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1784044005.336910:0:7963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784044005.336925:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784044005.337111:0:7963:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784044005.337134:0:7963:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9cc73983a754ffd3 00000100:00080000:1.0:1784044005.337144:0:7963:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784044005.337149:0:7963:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff904bff66f000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1784044005.337183:0:7963:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bfb3b9180 x1870705598683136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044005.337219:0:7963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1784044005.337277:0:7963:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044005.337281:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044005.337283:0:7963:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784044005.337286:0:7963:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044005.337290:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044005.337291:0:7963:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784044005.337294:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784044005.337304:0:7963:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784044005.337586:0:7963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7963:1870705598683264:0@lo:502: 00000100:00100000:1.0:1784044005.337664:0:7963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044005.337709:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598683264 00000100:00100000:1.0:1784044005.337715:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598683264 00000100:00100000:1.0:1784044005.337763:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784044005.337771:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:7963:x1870705598683264:12345-0@lo:502: 00000100:00100000:0.0:1784044005.338068:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598683136:0@lo:8: 00000100:00100000:0.0:1784044005.338118:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044005.338165:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598683136 00000100:00100000:2.0:1784044005.338171:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598683136 00000100:00100000:2.0:1784044005.338202:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784044005.338209:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3287:x1870705598683136:12345-0@lo:8: 00010000:00080000:2.0:1784044005.338239:0:6572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1784044005.338276:0:6572:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9cc73983a754ffda 00002000:00100000:2.0:1784044005.338293:0:6572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff904bfb3a8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784044005.338297:0:6572:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1784044005.338301:0:6572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784044005.338410:0:6572:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784044005.338570:0:6572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784044005.338594:0:6572:0:(import.c:65:import_set_state_nolock()) ffff904bfb3ae800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044005.338598:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:7963:x1870705598683264:12345-0@lo:502: Request processed in 825us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.338608:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784044005.338649:0:7963:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bda51fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044005.338669:0:7963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:7963:1870705598683264:0@lo:502: 00000100:00100000:2.0:1784044005.339472:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1870705598683136:12345-0@lo:8: Request processed in 1260us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044005.339482:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:1.0:1784044005.339599:0:7963:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044005.339605:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044005.339607:0:7963:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784044005.339612:0:7963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1784044005.339714:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1784044005.339739:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784044005.339750:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044005.339762:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044005.339772:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784044005.339774:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff904bd40e4d40 from 1 10000000:01000000:2.0:1784044005.339777:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784044005.339968:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044005.339983:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044005.339993:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044005.340011:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598683392:0@lo:101: 00000100:00100000:2.0:1784044005.340475:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044005.340510:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5cbf780 going to sleep for 11 seconds 00010000:00080000:0.0:1784044005.344055:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3b9180 x1870705598683136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044005.344085:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044005.344096:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784044005.344105:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784044005.344111:0:3287:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784044005.344115:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bff66f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784044005.344141:0:3287:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784044005.344148:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598683136:0@lo:8: 00000100:00100000:0.0:1784044005.344191:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598683392 00000100:00100000:0.0:1784044005.344197:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598683392 00000100:00100000:0.0:1784044005.344241:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784044005.344250:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598683392:12345-0@lo:101: 00010000:00010000:0.0:1784044005.344265:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044005.344285:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc0030a00/0x9cc73983a754ffe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a754ffe1 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044005.345268:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc0030a00/0x9cc73983a754ffe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a754ffe1 expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044005.345285:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc0030a00/0x9cc73983a754ffe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ffe1 expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044005.345463:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0030a00, rc 0) 00000100:00100000:0.0:1784044005.345592:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598683392:12345-0@lo:101: Request processed in 1342us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044005.345601:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784044005.355697:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598683392:0@lo:101: 00010000:00010000:3.0:1784044005.355727:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.355819:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044005.355939:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed281180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598683520:0@lo:501: 00000100:00100000:3.0:1784044005.356003:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.356049:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc3070300 going to sleep for 11 seconds 00000004:00080000:2.0:1784044005.356083:0:7964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1784044005.356126:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598683520 00000100:00100000:1.0:1784044005.356134:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598683520 00000100:00100000:1.0:1784044005.356179:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784044005.356189:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598683520:12345-0@lo:501: 00000004:00080000:2.0:1784044005.356505:0:7964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 183341638534ns, next at 0ns, rc = 0 00000100:00100000:1.0:1784044005.356956:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598683520:12345-0@lo:501: Request processed in 766us (950us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784044005.356966:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784044005.357188:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed281180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598683520:0@lo:501: 10000000:01000000:3.0:1784044005.357219:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784044005.357228:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044005.357238:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784044005.443548:0:7967:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1784044005.443590:0:7967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7967:1870705598683776:0@lo:7: 00000100:00100000:3.0:1784044005.443664:0:7967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.443722:0:7967:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be06ba600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044005.445057:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598683776 00000100:00100000:2.0:1784044005.445071:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598683776 00000100:00100000:2.0:1784044005.445257:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044005.445268:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7967:x1870705598683776:12345-0@lo:7: 00000100:00100000:3.0:1784044005.446077:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044005.446099:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598683648:0@lo:13: 00000100:00100000:3.0:1784044005.446162:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784044005.455712:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044005.465185:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598683648 00000100:00100000:3.0:1784044005.465198:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598683648 00000100:00100000:3.0:1784044005.465259:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044005.465269:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3290:x1870705598683648:12345-0@lo:13: 00002000:00000024:3.0:1784044005.465301:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1784044005.465385:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3290:x1870705598683648:12345-0@lo:13: Request processed in 118us (19222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044005.465392:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1784044005.468615:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bed281180 x1870705598683648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044005.468643:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598683648:0@lo:13: 00002000:00080000:2.0:1784044005.473315:0:6569:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1784044005.473324:0:6569:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784044005.473449:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7967:x1870705598683776:12345-0@lo:7: Request processed in 28171us (29773us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044005.473462:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1784044005.477776:0:7967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bed282a00 x1870705598683776/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784044021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044005.477798:0:7967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7967:1870705598683776:0@lo:7: 00000004:00080000:3.0:1784044005.477812:0:7967:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1784044005.477851:0:7967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7967:1870705598683904:0@lo:5: 00000100:00100000:3.0:1784044005.477937:0:7967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044005.477988:0:7967:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be06ba600 going to sleep for 11 seconds 00000100:00100000:1.0:1784044005.482907:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598683904 00000100:00100000:1.0:1784044005.482923:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598683904 00000100:00100000:1.0:1784044005.482980:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044005.482991:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7967:x1870705598683904:12345-0@lo:5: 00002000:00080000:1.0:1784044005.483026:0:6572:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1784044005.483039:0:6572:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1784044005.483405:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7967:x1870705598683904:12345-0@lo:5: Request processed in 415us (5467us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784044005.483413:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1784044005.483501:0:7967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bed282a00 x1870705598683904/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044005.483518:0:7967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7967:1870705598683904:0@lo:5: 00000004:00080000:1.0:1784044005.483531:0:7967:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1784044005.483567:0:7967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7967:1870705598684032:0@lo:700: 00000100:00100000:1.0:1784044005.483600:0:7967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044005.483633:0:7967:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044005.483650:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598684032 00000100:00100000:1.0:1784044005.483655:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598684032 00000100:00100000:1.0:1784044005.483701:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044005.483709:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7967:x1870705598684032:12345-0@lo:700: 00000100:00100000:1.0:1784044005.484885:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6578:1870705598684160:0@lo:700: 00000100:00100000:1.0:1784044005.484934:0:6578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044005.484965:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab9600 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.486850:0:6893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598684160 00000100:00100000:3.0:1784044005.486882:0:6893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598684160 00000100:00100000:3.0:1784044005.486945:0:6893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044005.486955:0:6893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0002:lustre-MDT0000-lwp-OST0001_UUID+5:6578:x1870705598684160:12345-0@lo:700: 00000004:00080000:1.0:1784044005.497435:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1784044005.562907:0:6893:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1784044005.570973:0:6893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0002:lustre-MDT0000-lwp-OST0001_UUID+5:6578:x1870705598684160:12345-0@lo:700: Request processed in 84010us (86028us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.570988:0:6893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784044005.571043:0:6578:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3b9c00 x1870705598684160/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784044021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044005.571060:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6578:1870705598684160:0@lo:700: 40000000:02000000:1.0:1784044005.571085:0:6578:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1784044005.693694:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1784044005.693715:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784044005.693908:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7967:x1870705598684032:12345-0@lo:700: Request processed in 210194us (210301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.693920:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784044005.694255:0:7967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3b8e00 x1870705598684032/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784044021 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044005.694268:0:7967:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1784044005.694285:0:7967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7967:1870705598684032:0@lo:700: 00000004:02000040:1.0:1784044005.754385:0:7967:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1784044005.768553:0:7967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7967:1870705598684288:0@lo:5: 00000100:00100000:1.0:1784044005.768624:0:7967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044005.768693:0:7967:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044005.768976:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598684288 00000100:00100000:3.0:1784044005.768986:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598684288 00000100:00100000:3.0:1784044005.769046:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784044005.769056:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7967:x1870705598684288:12345-0@lo:5: 00002000:00080000:2.0:1784044005.778937:0:6569:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1784044005.778966:0:6569:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1784044005.782402:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7967:x1870705598684288:12345-0@lo:5: Request processed in 13340us (13770us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784044005.782416:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784044005.789954:0:7967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3b9c00 x1870705598684288/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044021 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044005.789982:0:7967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7967:1870705598684288:0@lo:5: 00000004:00080000:1.0:1784044005.790000:0:7967:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1784044006.238932:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784044006.723211:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1784044007.262048:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044008.187603:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044008.187903:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582932352 00000100:00100000:0.0:1784044008.187927:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582932352 00000100:00100000:0.0:1784044008.187980:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:0.0:1784044008.187987:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2344:x1870705582932352:12345-192.168.204.50@tcp:250: 00010000:00080000:0.0:1784044008.188464:0:5764:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f40c65c2-a2d0-42d6-a031-2092177c578a@192.168.204.50@tcp t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:0.0:1784044008.188498:0:5764:0:(genops.c:1406:class_connect()) connect: client f40c65c2-a2d0-42d6-a031-2092177c578a, cookie 0x9cc73983a754ffef 00000100:00080000:0.0:1784044008.188645:0:5764:0:(import.c:65:import_set_state_nolock()) ffff904bc66fd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044008.188777:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+5:2344:x1870705582932352:12345-192.168.204.50@tcp:250: Request processed in 787us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044008.188785:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:1.0:1784044008.193594:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044008.193995:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582932224 00000100:00100000:2.0:1784044008.194062:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582932224 00000100:00100000:2.0:1784044008.194120:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:2.0:1784044008.194131:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+5:5553:x1870705582932224:12345-192.168.204.50@tcp:101: 00010000:00010000:2.0:1784044008.194147:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044008.194165:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f4600/0x9cc73983a754fff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead528 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044008.194198:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f4600/0x9cc73983a754fff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead528 expref: 6 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044008.194336:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f4600/0x9cc73983a754fff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead528 expref: 6 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044008.194345:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4600, rc 0) 00000100:00100000:2.0:1784044008.194402:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+6:5553:x1870705582932224:12345-192.168.204.50@tcp:101: Request processed in 273us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044008.194410:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:3.0:1784044008.196646:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044008.197080:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582932480 00000100:00100000:2.0:1784044008.197090:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582932480 00000100:00100000:2.0:1784044008.197152:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:2.0:1784044008.197162:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+6:5553:x1870705582932480:12345-192.168.204.50@tcp:501: 00000100:00100000:2.0:1784044008.197549:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+6:5553:x1870705582932480:12345-192.168.204.50@tcp:501: Request processed in 386us (910us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784044008.197568:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:1.0:1784044008.210838:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044008.211743:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582932608 00000100:00100000:2.0:1784044008.211756:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582932608 00000100:00100000:2.0:1784044008.211832:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1784044008.211843:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+6:5553:x1870705582932608:12345-192.168.204.50@tcp:101: 00010000:00010000:2.0:1784044008.211859:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044008.211902:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f5c00/0x9cc73983a754fffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead52f expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044008.211934:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f5c00/0x9cc73983a754fffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead52f expref: 7 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044008.211945:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f5c00/0x9cc73983a754fffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead52f expref: 7 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044008.211954:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5c00, rc 0) 00000100:00100000:2.0:1784044008.212017:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+7:5553:x1870705582932608:12345-192.168.204.50@tcp:101: Request processed in 176us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044008.212025:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:3.0:1784044008.221006:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044008.221312:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582932736 00000100:00100000:1.0:1784044008.221322:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582932736 00000100:00100000:1.0:1784044008.221502:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:1.0:1784044008.221512:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+7:5553:x1870705582932736:12345-192.168.204.50@tcp:501: 00000100:00100000:1.0:1784044008.224505:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+8:5553:x1870705582932736:12345-192.168.204.50@tcp:501: Request processed in 2984us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044008.224520:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:3.0:1784044008.228984:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044008.229111:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582932864 00000100:00100000:0.0:1784044008.229122:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582932864 00000100:00100000:0.0:1784044008.229803:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:0.0:1784044008.229815:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+8:5553:x1870705582932864:12345-192.168.204.50@tcp:503: 00000100:00100000:0.0:1784044008.230329:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+8:5553:x1870705582932864:12345-192.168.204.50@tcp:503: Request processed in 515us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044008.230337:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:3.0:1784044008.241384:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044008.242793:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582932992 00000100:00100000:1.0:1784044008.242807:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582932992 00000100:00100000:1.0:1784044008.242893:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:1.0:1784044008.242904:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+8:5571:x1870705582932992:12345-192.168.204.50@tcp:502: 00000100:00100000:1.0:1784044008.244542:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+8:5571:x1870705582932992:12345-192.168.204.50@tcp:502: Request processed in 1630us (3158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044008.244555:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:3.0:1784044008.273525:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044008.273685:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582933120 00000100:00100000:0.0:1784044008.273697:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582933120 00000100:00100000:0.0:1784044008.273763:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:0.0:1784044008.273773:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+8:5571:x1870705582933120:12345-192.168.204.50@tcp:502: 00000100:00100000:0.0:1784044008.274145:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+8:5571:x1870705582933120:12345-192.168.204.50@tcp:502: Request processed in 371us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044008.274154:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:3.0:1784044008.277324:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044008.277523:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582933248 00000100:00100000:1.0:1784044008.277545:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582933248 00000100:00100000:1.0:1784044008.277599:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:1.0:1784044008.277608:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+8:5553:x1870705582933248:12345-192.168.204.50@tcp:101: 00010000:00010000:1.0:1784044008.277636:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044008.277656:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1662000/0x9cc73983a7550004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead559 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044008.277694:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1662000/0x9cc73983a7550004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead559 expref: 9 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044008.277705:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1662000/0x9cc73983a7550004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead559 expref: 9 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044008.277715:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662000, rc 0) 00000100:00100000:1.0:1784044008.277776:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5553:x1870705582933248:12345-192.168.204.50@tcp:101: Request processed in 169us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044008.277790:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:3.0:1784044008.283001:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044008.283905:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582933376 00000100:00100000:2.0:1784044008.283918:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582933376 00000100:00100000:2.0:1784044008.283983:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:2.0:1784044008.283992:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5553:x1870705582933376:12345-192.168.204.50@tcp:256: 20000000:01000000:2.0:1784044008.284017:0:5763:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784044008.284039:0:5763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784044008.284042:0:5763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784044008.284045:0:5763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784044008.284051:0:5763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00010000:00010000:3.0:1784044008.286182:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044008.295008:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5553:x1870705582933376:12345-192.168.204.50@tcp:256: Request processed in 11006us (12008us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044008.295022:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:3.0:1784044008.299592:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044008.299805:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582933504 00000100:00100000:0.0:1784044008.299814:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582933504 00000100:00100000:0.0:1784044008.299898:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:0.0:1784044008.299921:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5553:x1870705582933504:12345-192.168.204.50@tcp:101: 00010000:00010000:0.0:1784044008.299937:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044008.299956:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc0030200/0x9cc73983a755000b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead560 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044008.299982:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc0030200/0x9cc73983a755000b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead560 expref: 10 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044008.299993:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc0030200/0x9cc73983a755000b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead560 expref: 10 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044008.300002:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0030200, rc 0) 00000100:00100000:0.0:1784044008.300056:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5553:x1870705582933504:12345-192.168.204.50@tcp:101: Request processed in 137us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044008.300063:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:3.0:1784044008.310511:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044008.310609:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582933632 00000100:00100000:2.0:1784044008.310628:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582933632 00000100:00100000:2.0:1784044008.310671:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:2.0:1784044008.310690:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5553:x1870705582933632:12345-192.168.204.50@tcp:501: 00000100:00100000:2.0:1784044008.310977:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5553:x1870705582933632:12345-192.168.204.50@tcp:501: Request processed in 289us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044008.310985:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:3.0:1784044008.313505:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044008.313589:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582933760 00000100:00100000:1.0:1784044008.313600:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582933760 00000100:00100000:1.0:1784044008.313660:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:1.0:1784044008.313669:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5553:x1870705582933760:12345-192.168.204.50@tcp:503: 00000100:00100000:1.0:1784044008.314036:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5553:x1870705582933760:12345-192.168.204.50@tcp:503: Request processed in 367us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044008.314052:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:3.0:1784044008.317996:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044008.318084:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582933888 00000100:00100000:0.0:1784044008.318093:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582933888 00000100:00100000:0.0:1784044008.318147:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:0.0:1784044008.318156:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5577:x1870705582933888:12345-192.168.204.50@tcp:502: 00000100:00100000:0.0:1784044008.318409:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5577:x1870705582933888:12345-192.168.204.50@tcp:502: Request processed in 253us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044008.318417:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:3.0:1784044008.324139:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044008.324228:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582934016 00000100:00100000:2.0:1784044008.324238:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582934016 00000100:00100000:2.0:1784044008.324290:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 127 00000100:00100000:2.0:1784044008.324300:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5577:x1870705582934016:12345-192.168.204.50@tcp:502: 00000100:00100000:2.0:1784044008.324532:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5577:x1870705582934016:12345-192.168.204.50@tcp:502: Request processed in 232us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044008.324548:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 127 00000100:00100000:3.0:1784044008.337957:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044008.338059:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582934144 00000100:00100000:2.0:1784044008.338069:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582934144 00000100:00100000:2.0:1784044008.338107:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:2.0:1784044008.338115:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2344:x1870705582934144:12345-192.168.204.50@tcp:38: 00010000:00080000:2.0:1784044008.338145:0:5770:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1784044008.338194:0:5770:0:(genops.c:1406:class_connect()) connect: client 3609c122-577c-43fa-ab52-dd2c7dc5cce7, cookie 0x9cc73983a7550012 00000004:00100000:2.0:1784044008.338227:0:5770:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1784044008.338233:0:5770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1784044008.400307:0:5770:0:(import.c:65:import_set_state_nolock()) ffff904bfb3ad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044008.400407:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2344:x1870705582934144:12345-192.168.204.50@tcp:38: Request processed in 62290us (62458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044008.400418:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00010000:00010000:3.0:1784044009.310068:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044009.408149:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044009.408198:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044009.408297:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582934272 00000100:00100000:0.0:1784044009.408308:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582934272 00000100:00100000:0.0:1784044009.408377:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582934400 00000100:00100000:0.0:1784044009.408380:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582934400 00000100:00100000:0.0:1784044009.408403:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1784044009.408414:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:0:x1870705582934272:12345-192.168.204.50@tcp:41: 00000004:00000024:0.0:1784044009.408472:0:5769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1784044009.408529:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:0:x1870705582934272:12345-192.168.204.50@tcp:41: Request processed in 117us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044009.408536:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1784044009.408553:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1784044009.408559:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:5553:x1870705582934400:12345-192.168.204.50@tcp:41: 00000004:00000024:0.0:1784044009.408569:0:5769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1784044009.408591:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:5553:x1870705582934400:12345-192.168.204.50@tcp:41: Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044009.408607:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00080000:2.0:1784044009.408665:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044009.413189:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044009.413484:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582934528 00000100:00100000:0.0:1784044009.413494:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582934528 00000100:00100000:0.0:1784044009.413574:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1784044009.413586:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:5553:x1870705582934528:12345-192.168.204.50@tcp:40: 00000100:00100000:0.0:1784044009.413964:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:5553:x1870705582934528:12345-192.168.204.50@tcp:40: Request processed in 380us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044009.413973:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1784044009.416634:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044009.416730:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044009.416756:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044009.416916:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582934656 00000100:00100000:0.0:1784044009.416925:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582934656 00000100:00100000:1.0:1784044009.416941:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582934784 00000100:00100000:1.0:1784044009.416947:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582934784 00000100:00100000:0.0:1784044009.416970:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1784044009.416976:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1870705582934656:12345-192.168.204.50@tcp:8: 00010000:00080000:0.0:1784044009.417013:0:6572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:0.0:1784044009.417054:0:6572:0:(genops.c:1406:class_connect()) connect: client 3609c122-577c-43fa-ab52-dd2c7dc5cce7, cookie 0x9cc73983a7550019 00002000:00100000:0.0:1784044009.417067:0:6572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3609c122-577c-43fa-ab52-dd2c7dc5cce7/ffff904bc66fe000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784044009.417101:0:6572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1784044009.417360:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582934912 00000100:00100000:2.0:1784044009.417364:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582934912 00000100:00100000:2.0:1784044009.417436:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1784044009.417444:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:5553:x1870705582934912:12345-192.168.204.50@tcp:33: 00002000:00080000:0.0:1784044009.418299:0:6572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784044009.418407:0:6572:0:(import.c:65:import_set_state_nolock()) ffff904bc66f9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044009.418564:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2344:x1870705582934656:12345-192.168.204.50@tcp:8: Request processed in 1585us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044009.420528:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:1.0:1784044009.420564:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044009.420722:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1784044009.420733:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1870705582934784:12345-192.168.204.50@tcp:8: 00010000:00080000:0.0:1784044009.420954:0:6572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:0.0:1784044009.421135:0:6572:0:(genops.c:1406:class_connect()) connect: client 3609c122-577c-43fa-ab52-dd2c7dc5cce7, cookie 0x9cc73983a7550020 00002000:00100000:0.0:1784044009.421150:0:6572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3609c122-577c-43fa-ab52-dd2c7dc5cce7/ffff904bc66fa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784044009.421175:0:6572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1784044009.421661:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582935040 00000100:00100000:2.0:1784044009.421670:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582935040 00000100:00100000:2.0:1784044009.421719:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 128 00000100:00100000:2.0:1784044009.421727:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2345:x1870705582935040:12345-192.168.204.50@tcp:400: 00000100:00100000:2.0:1784044009.421930:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2345:x1870705582935040:12345-192.168.204.50@tcp:400: Request processed in 201us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044009.421939:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 128 00002000:00080000:0.0:1784044009.424778:0:6572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784044009.424829:0:6572:0:(import.c:65:import_set_state_nolock()) ffff904bc66fc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044009.424936:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2344:x1870705582934784:12345-192.168.204.50@tcp:8: Request processed in 4200us (8175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044009.424947:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000004:00080000:2.0:1784044009.435951:0:5772:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18452us 00000004:00200000:3.0:1784044009.451411:0:5772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784044009.451613:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:5553:x1870705582934912:12345-192.168.204.50@tcp:33: Request processed in 34163us (34980us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044009.451627:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1784044009.648489:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044009.648686:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582935168 00000100:00100000:3.0:1784044009.648695:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582935168 00000100:00100000:3.0:1784044009.648770:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1784044009.648780:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:5594:x1870705582935168:12345-192.168.204.50@tcp:101: 00010000:00010000:3.0:1784044009.648802:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044009.648828:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1679200/0x9cc73983a7550027 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead58a expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044009.649648:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a755002e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044009.649668:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a755002e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044009.649684:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a755002e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044009.652606:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784044009.652616:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044009.653640:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a755002e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044009.653697:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1679200/0x9cc73983a7550027 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead58a expref: 8 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044009.653744:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a755002e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead58a expref: 7 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044009.653754:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e200) 00010000:00010000:3.0:1784044009.653758:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044009.653762:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1678c00, rc 0) 00000100:00100000:3.0:1784044009.653840:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:5594:x1870705582935168:12345-192.168.204.50@tcp:101: Request processed in 5059us (5358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044009.656144:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00010000:00010000:3.0:1784044010.334535:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044010.398243:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598684672:0@lo:400: 00000100:00100000:3.0:1784044010.398311:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.398385:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598685184:0@lo:400: 00000100:00100000:3.0:1784044010.398419:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.398463:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044010.398470:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598684800:0@lo:400: 00000100:00100000:3.0:1784044010.398529:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.398566:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598685184 00000100:00100000:3.0:1784044010.398585:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598685184 00000100:00100000:3.0:1784044010.398652:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044010.398662:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598685184:12345-0@lo:400: 00000100:00100000:3.0:1784044010.398735:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598685184:12345-0@lo:400: Request processed in 70us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.398742:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1784044010.398788:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc4cfc000 x1870705598685184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044010.398806:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784044010.398821:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598685184:0@lo:400: 00000100:00100000:0.0:1784044010.398954:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598684544:0@lo:400: 00000100:00100000:1.0:1784044010.398977:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598684416:0@lo:13: 00000100:00100000:0.0:1784044010.398995:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044010.399023:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.399045:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598685056:0@lo:400: 00000100:00100000:1.0:1784044010.399050:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598684928:0@lo:400: 00000100:00100000:0.0:1784044010.399085:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044010.399091:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.399127:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598684672 00000100:00100000:0.0:1784044010.399132:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598684672 00000100:00100000:1.0:1784044010.399147:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598684800 00000100:00100000:1.0:1784044010.399153:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598684800 00000100:00100000:0.0:1784044010.399166:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598685056 00000100:00100000:0.0:1784044010.399171:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598685056 00000100:00100000:1.0:1784044010.399187:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044010.399197:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598684672:12345-0@lo:400: 00000100:00100000:0.0:1784044010.399209:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784044010.399218:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598684800:12345-0@lo:400: 00000100:00100000:1.0:1784044010.399244:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598684672:12345-0@lo:400: Request processed in 49us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.399258:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044010.399272:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598684800:12345-0@lo:400: Request processed in 53us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.399282:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044010.399294:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598685056:12345-0@lo:400: 00000100:00100000:1.0:1784044010.399327:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598685056:12345-0@lo:400: Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00080000:2.0:1784044010.399392:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044010.399397:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044010.399425:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598684928 00000100:00100000:2.0:1784044010.399429:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598684928 00000100:00100000:2.0:1784044010.399461:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044010.399468:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598684928:12345-0@lo:400: 00000100:00100000:2.0:1784044010.399508:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598684928:12345-0@lo:400: Request processed in 41us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.399514:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1784044010.399535:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784044010.399554:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc4cfc380 x1870705598684928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044010.399564:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598684928:0@lo:400: 00000100:00100000:2.0:1784044010.399614:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598684800:0@lo:400: 00000100:00100000:2.0:1784044010.399623:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598684672:0@lo:400: 00000100:00100000:2.0:1784044010.399661:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598685056:0@lo:400: 00000100:00100000:3.0:1784044010.399990:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598684544 00000100:00100000:3.0:1784044010.399994:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598684544 00000100:00100000:3.0:1784044010.400032:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784044010.400039:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598684544:12345-0@lo:400: 00000100:00100000:3.0:1784044010.400080:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598684544:12345-0@lo:400: Request processed in 42us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.400087:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784044010.400114:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598684416 00000100:00100000:3.0:1784044010.400117:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598684416 00000100:00100000:3.0:1784044010.400140:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784044010.400146:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598684416:12345-0@lo:13: 00002000:00000024:3.0:1784044010.400160:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044010.400195:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598684416:12345-0@lo:13: Request processed in 48us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.400201:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784044010.400226:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598684544:0@lo:400: 00010000:00080000:3.0:1784044010.400249:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bed282680 x1870705598684416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044010.400262:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598684416:0@lo:13: 00000100:00100000:0.0:1784044010.401905:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044010.402020:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784044010.910241:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044010.910271:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598685312:0@lo:13: 00000100:00100000:2.0:1784044010.910344:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.910448:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598685312 00000100:00100000:3.0:1784044010.910455:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598685312 00000100:00100000:3.0:1784044010.910496:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784044010.910504:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598685312:12345-0@lo:13: 00002000:00000024:3.0:1784044010.910537:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044010.910593:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598685312:12345-0@lo:13: Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.910600:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784044010.910670:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc5adf800 x1870705598685312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044010.910697:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598685312:0@lo:13: 00010000:00010000:3.0:1784044011.365824:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784044011.474702:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000100:00100000:0.0:1784044011.784807:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044011.784974:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582935296 00000100:00100000:2.0:1784044011.784982:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582935296 00000100:00100000:2.0:1784044011.785056:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:2.0:1784044011.785067:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:5646:x1870705582935296:12345-192.168.204.50@tcp:41: 00000004:00000024:2.0:1784044011.785107:0:5770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1784044011.785172:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:5646:x1870705582935296:12345-192.168.204.50@tcp:41: Request processed in 101us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044011.785180:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00080000:0.0:1784044011.785453:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044011.797101:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044011.797527:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582935424 00000100:00100000:3.0:1784044011.797540:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582935424 00000100:00100000:3.0:1784044011.797770:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1784044011.797783:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:5646:x1870705582935424:12345-192.168.204.50@tcp:13: 00002000:00000024:3.0:1784044011.797835:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044011.797960:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:5646:x1870705582935424:12345-192.168.204.50@tcp:13: Request processed in 178us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044011.797967:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00080000:0.0:1784044011.798801:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044011.801902:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044011.802013:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582935552 00000100:00100000:3.0:1784044011.802030:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582935552 00000100:00080000:0.0:1784044011.802255:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044011.802464:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1784044011.802483:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:5646:x1870705582935552:12345-192.168.204.50@tcp:13: 00002000:00000024:3.0:1784044011.802540:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044011.802650:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:5646:x1870705582935552:12345-192.168.204.50@tcp:13: Request processed in 174us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044011.805808:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00010000:00010000:3.0:1784044012.396501:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784044012.485769:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00010000:00010000:3.0:1784044013.406463:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784044013.536697:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000001:02000400:2.0:1784044014.201736:0:8136:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1784044014.433666:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044014.461036:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044014.461097:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044014.461159:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044014.461233:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582935680 00000100:00100000:3.0:1784044014.461250:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582935680 00000100:00100000:1.0:1784044014.461262:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582935808 00000100:00100000:1.0:1784044014.461273:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582935808 00000100:00100000:3.0:1784044014.461338:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:3.0:1784044014.461353:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2346:x1870705582935680:12345-192.168.204.50@tcp:400: 00000100:00100000:1.0:1784044014.461372:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:1.0:1784044014.461388:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705582935808:12345-192.168.204.50@tcp:400: 00000100:00100000:3.0:1784044014.461454:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2346:x1870705582935680:12345-192.168.204.50@tcp:400: Request processed in 102us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044014.461465:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705582935808:12345-192.168.204.50@tcp:400: Request processed in 77us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044014.461470:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:1.0:1784044014.461487:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00080000:1.0:1784044014.461557:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044014.462199:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582935936 00000100:00100000:0.0:1784044014.462206:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582935936 00000100:00100000:0.0:1784044014.462319:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1784044014.462329:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582935936:12345-192.168.204.50@tcp:400: 00000100:00100000:0.0:1784044014.462395:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582935936:12345-192.168.204.50@tcp:400: Request processed in 68us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044014.462403:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00080000:1.0:1784044014.464225:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044014.464312:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044014.465771:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582936064 00000100:00100000:1.0:1784044014.465789:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582936064 00000100:00100000:1.0:1784044014.465943:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1784044014.465959:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582936064:12345-192.168.204.50@tcp:400: 00000100:00080000:0.0:1784044014.467651:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044014.467912:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582936064:12345-192.168.204.50@tcp:400: Request processed in 1950us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044014.467927:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00010000:00010000:3.0:1784044015.461542:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044015.519271:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598685696:0@lo:400: 00000100:00100000:2.0:1784044015.519339:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044015.519395:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044015.519402:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598685824:0@lo:400: 00000100:00100000:2.0:1784044015.519428:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044015.519467:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598685696 00000100:00100000:2.0:1784044015.519474:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598685696 00000100:00100000:2.0:1784044015.519537:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044015.519546:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598685696:12345-0@lo:400: 00000100:00100000:2.0:1784044015.519596:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598685696:12345-0@lo:400: Request processed in 51us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044015.519604:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044015.519644:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598685696:0@lo:400: 00000100:00080000:0.0:1784044015.519773:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044015.519800:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598685440:0@lo:400: 00000100:00100000:0.0:1784044015.519833:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044015.519889:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598685952:0@lo:400: 00000100:00100000:0.0:1784044015.519915:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044015.519935:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784044015.519941:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598685568:0@lo:400: 00000100:00100000:0.0:1784044015.519961:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044015.519977:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598686080:0@lo:400: 00000100:00100000:0.0:1784044015.520011:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044015.520034:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598685952 00000100:00100000:0.0:1784044015.520037:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598685952 00000100:00100000:0.0:1784044015.520064:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598685568 00000100:00100000:0.0:1784044015.520066:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598685568 00000100:00100000:0.0:1784044015.520079:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044015.520084:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598685952:12345-0@lo:400: 00000100:00100000:0.0:1784044015.520118:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598685952:12345-0@lo:400: Request processed in 33us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044015.520125:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044015.520137:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784044015.520142:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598685568:12345-0@lo:400: 00000100:00100000:0.0:1784044015.520166:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598685568:12345-0@lo:400: Request processed in 24us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044015.520172:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784044015.520190:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598685824 00000100:00100000:0.0:1784044015.520194:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598685824 00000100:00100000:0.0:1784044015.520220:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598686080 00000100:00100000:0.0:1784044015.520223:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598686080 00000100:00100000:0.0:1784044015.520237:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784044015.520242:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598685824:12345-0@lo:400: 00000100:00100000:0.0:1784044015.520273:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598685824:12345-0@lo:400: Request processed in 30us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044015.520279:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784044015.520289:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784044015.520294:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598686080:12345-0@lo:400: 00000100:00100000:0.0:1784044015.520319:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598686080:12345-0@lo:400: Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044015.520330:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1784044015.520344:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044015.520347:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044015.520349:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044015.520368:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598685568:0@lo:400: 00010000:00080000:0.0:1784044015.520381:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0232300 x1870705598686080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044015.520391:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598686080:0@lo:400: 00000100:00100000:0.0:1784044015.520400:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598685952:0@lo:400: 00010000:00080000:0.0:1784044015.520431:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc4cfdc00 x1870705598685824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044015.520440:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598685824:0@lo:400: 00000100:00100000:2.0:1784044015.520567:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598685440 00000100:00100000:2.0:1784044015.520572:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598685440 00000100:00100000:2.0:1784044015.520608:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784044015.520615:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598685440:12345-0@lo:400: 00000100:00100000:2.0:1784044015.520651:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598685440:12345-0@lo:400: Request processed in 36us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044015.520657:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784044015.520724:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598685440:0@lo:400: 00000100:00100000:0.0:1784044015.520988:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044015.520999:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598686208:0@lo:13: 00000100:00100000:0.0:1784044015.521030:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044015.521059:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598686208 00000100:00100000:0.0:1784044015.521063:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598686208 00000100:00100000:0.0:1784044015.521091:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044015.521098:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598686208:12345-0@lo:13: 00002000:00000024:0.0:1784044015.521124:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044015.521160:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598686208:12345-0@lo:13: Request processed in 62us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044015.521167:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1784044015.521213:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc5adf480 x1870705598686208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044015.521227:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598686208:0@lo:13: 00000100:00100000:1.0:1784044016.030633:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044016.030663:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598686336:0@lo:13: 00000100:00100000:1.0:1784044016.030738:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.031298:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598686336 00000100:00100000:0.0:1784044016.031308:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598686336 00000100:00100000:0.0:1784044016.031364:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784044016.031375:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598686336:12345-0@lo:13: 00002000:00000024:0.0:1784044016.031412:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044016.031491:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598686336:12345-0@lo:13: Request processed in 117us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.031499:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1784044016.031575:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0232d80 x1870705598686336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044016.031594:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598686336:0@lo:13: 00010000:00010000:1.0:1784044016.480556:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044017.502413:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784044017.679618:0:8284:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe080c59d0 20000000:00000080:1.0:1784044017.679638:0:8284:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff904bf566e800 uarg=0000000000000000 20000000:01000000:1.0:1784044017.679675:0:8284:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1784044017.679677:0:8284:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1784044017.679680:0:8284:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1784044017.679685:0:8284:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1784044017.679690:0:8284:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1784044017.679705:0:8284:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784044017.679707:0:8284:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784044017.679899:0:8284:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784044017.679902:0:8284:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784044017.684541:0:8285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1784044017.685793:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1784044017.685919:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1784044017.685965:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1784044017.685980:0:8284:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784044017.685983:0:8284:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784044017.687682:0:8286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1784044017.689676:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1784044017.690115:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1784044017.690253:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1784044017.690275:0:8284:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784044017.690277:0:8284:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784044017.691731:0:8287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1784044017.692398:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1784044017.692466:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1784044017.692525:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1784044017.692540:0:8284:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784044017.692542:0:8284:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784044017.697579:0:8288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1784044017.698296:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1784044017.698355:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1784044017.698396:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1784044017.698415:0:8284:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784044017.698450:0:8284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698470:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1678200/0x9cc73983a754ff32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff2b expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698478:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc0031400/0x9cc73983a754ff5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff55 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698485:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1662c00/0x9cc73983a754ff86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff7f expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698492:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1662e00/0x9cc73983a754ff94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff8d expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698499:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1662200/0x9cc73983a754ffa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff9b expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698506:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1679c00/0x9cc73983a754ffbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ffb7 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698512:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc0030a00/0x9cc73983a754ffe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ffe1 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698521:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc81f4600/0x9cc73983a754fff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead528 expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698529:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc81f5c00/0x9cc73983a754fffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead52f expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698536:0:8284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698589:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc81f5c00/0x9cc73983a754fffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead52f expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698604:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904bc81f5c00/0x9cc73983a754fffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead52f expref: 9 pid: 5763 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.698618:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598686464:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044017.698733:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc81f4600/0x9cc73983a754fff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead528 expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698742:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904bc81f4600/0x9cc73983a754fff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead528 expref: 9 pid: 5763 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.698751:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598686592:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044017.698782:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc0030a00/0x9cc73983a754ffe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754ffe1 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698790:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc0030a00/0x9cc73983a754ffe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754ffe1 expref: 18 pid: 5762 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.698799:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598686720:0@lo:104: 00000100:00100000:2.0:1784044017.698837:0:8284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044017.698886:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1679c00/0x9cc73983a754ffbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754ffb7 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698894:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1679c00/0x9cc73983a754ffbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754ffb7 expref: 18 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.698912:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598686848:0@lo:104: 00000100:00100000:2.0:1784044017.698936:0:8284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044017.698957:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1662200/0x9cc73983a754ffa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754ff9b expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.698965:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1662200/0x9cc73983a754ffa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754ff9b expref: 18 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.698973:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598686976:0@lo:104: 00010000:00010000:2.0:1784044017.698997:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1662e00/0x9cc73983a754ff94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754ff8d expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.699004:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1662e00/0x9cc73983a754ff94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754ff8d expref: 18 pid: 5764 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044017.699414:0:5753:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784044017.699433:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044017.699468:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598686720 00000100:00100000:1.0:1784044017.699475:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598686720 00000100:00100000:1.0:1784044017.699508:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598686848 00000100:00100000:1.0:1784044017.699510:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598686848 00000100:00100000:1.0:1784044017.699518:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598686976 00000100:00100000:1.0:1784044017.699520:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598686976 00000100:00100000:1.0:1784044017.699532:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044017.699541:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+5:8284:x1870705598686720:12345-0@lo:104: 00010000:00010000:1.0:1784044017.699553:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.699597:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044017.699603:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+5:8284:x1870705598686720:12345-0@lo:104: Request processed in 63us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044017.699610:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044017.699625:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784044017.699631:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:8284:x1870705598686848:12345-0@lo:104: 00010000:00010000:1.0:1784044017.699638:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.699667:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784044017.699672:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:8284:x1870705598686848:12345-0@lo:104: Request processed in 42us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044017.699678:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784044017.699709:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044017.699715:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:8284:x1870705598686976:12345-0@lo:104: 00010000:00010000:1.0:1784044017.699721:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.699772:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784044017.699777:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:8284:x1870705598686976:12345-0@lo:104: Request processed in 63us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044017.699783:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1784044017.699805:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784044017.699811:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.699818:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4800 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784044017.699822:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.699830:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044017.699917:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044017.699923:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784044017.699949:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.699956:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044017.699975:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.699982:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a754ffe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ffe8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.700005:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044017.700008:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.701326:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663400 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784044017.701332:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.701340:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044017.701347:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044017.701352:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784044017.701388:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.701395:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044017.701405:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.701412:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a754ffb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ffbe expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.701424:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044017.701428:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.701456:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1678600 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784044017.701458:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.701465:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044017.701470:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044017.701474:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784044017.701489:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.701495:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044017.701507:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.701514:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a754ff9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ffa2 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.701524:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044017.701526:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044017.701527:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044017.701688:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598687488:0@lo:103: 00000100:00100000:3.0:1784044017.701763:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044017.702102:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598687104:0@lo:104: 00000100:00100000:2.0:1784044017.702135:0:8284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044017.702323:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598687488 00000100:00100000:1.0:1784044017.702330:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598687488 00000100:00100000:0.0:1784044017.702349:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598687232:0@lo:103: 00010000:00010000:1.0:1784044017.702362:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1662200/0x9cc73983a754ffa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff9b expref: 19 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044017.702386:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044017.702403:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598687232 00000100:00100000:1.0:1784044017.702416:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598687232 00000100:00100000:0.0:1784044017.702432:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1784044017.702434:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc0030a00/0x9cc73983a754ffe8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ffe1 expref: 20 pid: 5762 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044017.702452:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598687360:0@lo:103: 00000100:00100000:1.0:1784044017.702467:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044017.702478:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3290:x1870705598687488:12345-0@lo:103: 00010000:00010000:1.0:1784044017.702491:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784044017.702497:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784044017.702500:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1662200/0x9cc73983a754ffa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff9b expref: 20 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.702513:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1662200/0x9cc73983a754ffa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754ff9b expref: 20 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044017.702530:0:5757:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1784044017.702534:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044017.702540:0:5757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1784044017.702577:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3290:x1870705598687488:12345-0@lo:103: Request processed in 101us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044017.702585:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044017.702603:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598687360 00000100:00100000:1.0:1784044017.702607:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598687360 00010000:00010000:1.0:1784044017.702620:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1679c00/0x9cc73983a754ffbe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ffb7 expref: 20 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044017.702636:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784044017.702643:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3288:x1870705598687232:12345-0@lo:103: 00010000:00010000:1.0:1784044017.702651:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044017.702656:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc0030a00/0x9cc73983a754ffe8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ffe1 expref: 20 pid: 5762 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.702664:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc0030a00/0x9cc73983a754ffe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754ffe1 expref: 20 pid: 5762 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.702685:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044017.702716:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3288:x1870705598687232:12345-0@lo:103: Request processed in 74us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044017.702723:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784044017.702748:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044017.702756:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598687360:12345-0@lo:103: 00010000:00010000:1.0:1784044017.702763:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044017.702768:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1679c00/0x9cc73983a754ffbe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ffb7 expref: 19 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.702776:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1679c00/0x9cc73983a754ffbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754ffb7 expref: 19 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.702785:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044017.702809:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598687360:12345-0@lo:103: Request processed in 54us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044017.702815:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044017.703939:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598687360:0@lo:103: 00000100:00100000:0.0:1784044017.703954:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598687232:0@lo:103: 00010000:00010000:2.0:1784044017.704564:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1662c00/0x9cc73983a754ff86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754ff7f expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.704580:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1662c00/0x9cc73983a754ff86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754ff7f expref: 18 pid: 5764 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.704594:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598687616:0@lo:104: 00000100:00100000:2.0:1784044017.704638:0:8284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044017.704955:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044017.704996:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582936192 00000100:00100000:1.0:1784044017.705003:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582936192 00010000:00010000:1.0:1784044017.705035:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc81f5c00/0x9cc73983a754fffd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead52f expref: 10 pid: 5763 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044017.705058:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1784044017.705067:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582936192:12345-192.168.204.50@tcp:103: 00010000:00010000:1.0:1784044017.705080:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044017.705085:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc81f5c00/0x9cc73983a754fffd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead52f expref: 10 pid: 5763 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.705114:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc81f5c00/0x9cc73983a754fffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead52f expref: 10 pid: 5763 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044017.705130:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044017.705242:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582936192:12345-192.168.204.50@tcp:103: Request processed in 175us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044017.705251:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00010000:00010000:2.0:1784044017.708132:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc0031400/0x9cc73983a754ff5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754ff55 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.708170:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc0031400/0x9cc73983a754ff5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754ff55 expref: 18 pid: 5762 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.708185:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0232a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598687744:0@lo:104: 00000100:00100000:2.0:1784044017.708243:0:8284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044017.708447:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598687104 00000100:00100000:3.0:1784044017.708456:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598687104 00000100:00100000:3.0:1784044017.708499:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598687616 00000100:00100000:3.0:1784044017.708502:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598687616 00000100:00100000:3.0:1784044017.708517:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784044017.708526:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:8284:x1870705598687104:12345-0@lo:104: 00010000:00010000:3.0:1784044017.708539:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044017.708611:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044017.708617:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:8284:x1870705598687104:12345-0@lo:104: Request processed in 93us (6482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044017.708636:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784044017.708651:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044017.708657:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:8284:x1870705598687616:12345-0@lo:104: 00010000:00010000:3.0:1784044017.708664:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044017.708692:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784044017.708696:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:8284:x1870705598687616:12345-0@lo:104: Request processed in 41us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044017.708702:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1784044017.708802:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044017.708809:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.708817:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1678400 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784044017.708822:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.708830:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044017.708850:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044017.708856:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784044017.708908:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.708915:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044017.708929:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.708947:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1678400/0x9cc73983a754ff8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff94 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.708959:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044017.708962:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.708967:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1679400 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784044017.708970:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.708976:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044017.708982:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044017.708988:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784044017.709003:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.709008:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044017.709021:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.709028:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1679400/0x9cc73983a754ff7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff86 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.709038:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044017.709045:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044017.709047:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044017.709061:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598688000:0@lo:103: 00000100:00100000:0.0:1784044017.709093:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044017.709138:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598687872:0@lo:103: 00000100:00100000:0.0:1784044017.709160:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044017.709189:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598688000 00000100:00100000:0.0:1784044017.709193:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598688000 00010000:00010000:0.0:1784044017.709212:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1662c00/0x9cc73983a754ff86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff7f expref: 19 pid: 5764 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044017.709226:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598687872 00000100:00100000:0.0:1784044017.709229:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598687872 00010000:00010000:0.0:1784044017.709240:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1662e00/0x9cc73983a754ff94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff8d expref: 20 pid: 5764 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044017.709251:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044017.709257:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3288:x1870705598688000:12345-0@lo:103: 00010000:00010000:0.0:1784044017.709266:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044017.709272:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1662c00/0x9cc73983a754ff86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff7f expref: 20 pid: 5764 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.709281:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1662c00/0x9cc73983a754ff86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754ff7f expref: 20 pid: 5764 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.709298:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044017.709324:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3288:x1870705598688000:12345-0@lo:103: Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044017.709331:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044017.709344:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784044017.709357:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598687872:12345-0@lo:103: 00010000:00010000:0.0:1784044017.709365:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044017.709369:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1662e00/0x9cc73983a754ff94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff8d expref: 19 pid: 5764 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.709378:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1662e00/0x9cc73983a754ff94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754ff8d expref: 19 pid: 5764 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.709387:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044017.709418:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598687872:12345-0@lo:103: Request processed in 62us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044017.709424:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784044017.709475:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598687872:0@lo:103: 00000100:00100000:0.0:1784044017.709500:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598688000:0@lo:103: 00000100:00100000:0.0:1784044017.709965:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044017.709987:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582936320 00000100:00100000:0.0:1784044017.709992:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582936320 00010000:00010000:0.0:1784044017.710012:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc81f4600/0x9cc73983a754fff6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead528 expref: 10 pid: 5763 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044017.710033:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:0.0:1784044017.710039:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582936320:12345-192.168.204.50@tcp:103: 00010000:00010000:0.0:1784044017.710049:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044017.710053:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc81f4600/0x9cc73983a754fff6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead528 expref: 10 pid: 5763 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.710063:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc81f4600/0x9cc73983a754fff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead528 expref: 10 pid: 5763 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.710081:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044017.710119:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582936320:12345-192.168.204.50@tcp:103: Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044017.710125:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00010000:00010000:2.0:1784044017.710660:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1678200/0x9cc73983a754ff32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754ff2b expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.710672:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1678200/0x9cc73983a754ff32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754ff2b expref: 18 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.710682:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598688128:0@lo:104: 00000100:00100000:2.0:1784044017.710713:0:8284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044017.710725:0:8284:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2d80 going to sleep for 11 seconds 00010000:00010000:2.0:1784044017.710755:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f5c00/0x9cc73983a754fffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead52f expref: 9 pid: 5763 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.710769:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598686464:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044017.710780:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f4600/0x9cc73983a754fff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead528 expref: 8 pid: 5763 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.710788:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598686592:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044017.710798:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc0030a00/0x9cc73983a754ffe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754ffe1 expref: 18 pid: 5762 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.710808:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598686720:0@lo:104: 00010000:00010000:2.0:1784044017.710818:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1679c00/0x9cc73983a754ffbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754ffb7 expref: 17 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.710847:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598686848:0@lo:104: 00010000:00010000:2.0:1784044017.710881:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1662200/0x9cc73983a754ffa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754ff9b expref: 16 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.710892:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598686976:0@lo:104: 00010000:00010000:2.0:1784044017.710904:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1662e00/0x9cc73983a754ff94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754ff8d expref: 15 pid: 5764 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.710910:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598687104:0@lo:104: 00010000:00010000:2.0:1784044017.710919:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1662c00/0x9cc73983a754ff86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754ff7f expref: 14 pid: 5764 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044017.710926:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598687616:0@lo:104: 00000100:00100000:2.0:1784044017.710948:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598687744 00000100:00100000:2.0:1784044017.710952:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598687744 00000100:00100000:2.0:1784044017.710977:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598688128 00000100:00100000:2.0:1784044017.710980:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598688128 00000100:00100000:2.0:1784044017.710993:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784044017.711000:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:8284:x1870705598687744:12345-0@lo:104: 00010000:00010000:2.0:1784044017.711011:0:6585:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711056:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784044017.711062:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:8284:x1870705598687744:12345-0@lo:104: Request processed in 63us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044017.711068:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784044017.711082:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784044017.711095:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:8284:x1870705598688128:12345-0@lo:104: 00010000:00010000:2.0:1784044017.711103:0:6585:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711131:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784044017.711136:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:8284:x1870705598688128:12345-0@lo:104: Request processed in 42us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044017.711142:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1784044017.711158:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044017.711163:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711171:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044017.711174:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711182:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044017.711189:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044017.711195:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784044017.711219:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711225:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044017.711240:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711258:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc0031200/0x9cc73983a754ff55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff5c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711269:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044017.711273:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711279:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031000 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044017.711282:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711289:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044017.711296:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044017.711301:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784044017.711315:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711321:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044017.711329:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711336:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc0031000/0x9cc73983a754ff2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff32 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044017.711348:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044017.711356:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044017.711358:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044017.711379:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0232a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598687744:0@lo:104: 00000100:00100000:2.0:1784044017.711385:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870705598688128:0@lo:104: 00010000:00010000:2.0:1784044017.711413:0:8284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044017.711921:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598688256:0@lo:103: 00000100:00100000:0.0:1784044017.711963:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044017.712007:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044017.712013:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598688384:0@lo:103: 00000100:00100000:0.0:1784044017.712033:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044017.712061:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598688256 00000100:00100000:0.0:1784044017.712065:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598688256 00010000:00010000:0.0:1784044017.712086:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc0031400/0x9cc73983a754ff5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff55 expref: 14 pid: 5762 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044017.712101:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598688384 00000100:00100000:0.0:1784044017.712104:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598688384 00010000:00010000:0.0:1784044017.712112:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1678200/0x9cc73983a754ff32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff2b expref: 15 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044017.712123:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044017.712130:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:3289:x1870705598688256:12345-0@lo:103: 00010000:00010000:0.0:1784044017.712140:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044017.712144:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc0031400/0x9cc73983a754ff5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff55 expref: 15 pid: 5762 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712154:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc0031400/0x9cc73983a754ff5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754ff55 expref: 15 pid: 5762 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712181:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc0031400/0x9cc73983a754ff5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754ff55 expref: 15 pid: 5762 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712195:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044017.712246:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:3289:x1870705598688256:12345-0@lo:103: Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044017.712255:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044017.712274:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784044017.712281:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:3291:x1870705598688384:12345-0@lo:103: 00010000:00010000:0.0:1784044017.712289:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044017.712294:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1678200/0x9cc73983a754ff32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff2b expref: 13 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712303:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1678200/0x9cc73983a754ff32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754ff2b expref: 13 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044017.712307:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598687488:0@lo:103: 00010000:00010000:0.0:1784044017.712322:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1678200/0x9cc73983a754ff32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754ff2b expref: 13 pid: 5763 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712337:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712345:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712359:0:5756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712366:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712380:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712386:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712392:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044017.712396:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712403:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712425:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044017.712435:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044017.712474:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:3291:x1870705598688384:12345-0@lo:103: Request processed in 194us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044017.712479:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1784044017.712497:0:8284:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044017.712507:0:8284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044017.712514:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f5200/0x9cc73983a7550035 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044017.712707:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598688256:0@lo:103: 00010000:00010000:2.0:1784044017.712934:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044017.713417:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598688384:0@lo:103: 00010000:00010000:2.0:1784044018.526264:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044019.258169:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044019.258240:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582936448 00000100:00100000:3.0:1784044019.258251:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582936448 00000100:00100000:3.0:1784044019.258359:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 132 00000100:00100000:3.0:1784044019.258372:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+8:5567:x1870705582936448:12345-192.168.204.50@tcp:101: 00010000:00010000:3.0:1784044019.258392:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044019.258429:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1678200/0x9cc73983a755003c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead591 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.258489:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1678200/0x9cc73983a755003c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead591 expref: 9 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.258502:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1678200/0x9cc73983a755003c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead591 expref: 9 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.258513:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1678200, rc 0) 00000100:00100000:3.0:1784044019.258582:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5567:x1870705582936448:12345-192.168.204.50@tcp:101: Request processed in 212us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.258589:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 132 00000100:00100000:0.0:1784044019.262966:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044019.263244:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582936576 00000100:00100000:3.0:1784044019.263256:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582936576 00000100:00100000:3.0:1784044019.263327:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:3.0:1784044019.263338:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5567:x1870705582936576:12345-192.168.204.50@tcp:501: 00000100:00100000:3.0:1784044019.264020:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5567:x1870705582936576:12345-192.168.204.50@tcp:501: Request processed in 682us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.264028:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:0.0:1784044019.273363:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044019.274216:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582936704 00000100:00100000:3.0:1784044019.274227:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582936704 00000100:00100000:3.0:1784044019.274296:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:3.0:1784044019.274305:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5567:x1870705582936704:12345-192.168.204.50@tcp:503: 00000100:00100000:3.0:1784044019.274854:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5567:x1870705582936704:12345-192.168.204.50@tcp:503: Request processed in 547us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.274881:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:0.0:1784044019.281891:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044019.282580:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582936832 00000100:00100000:3.0:1784044019.282604:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582936832 00000100:00100000:3.0:1784044019.282717:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00100000:3.0:1784044019.282729:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+9:6040:x1870705582936832:12345-192.168.204.50@tcp:502: 00000100:00100000:3.0:1784044019.283162:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+9:6040:x1870705582936832:12345-192.168.204.50@tcp:502: Request processed in 434us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.283170:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00100000:0.0:1784044019.286384:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044019.286609:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582936960 00000100:00100000:3.0:1784044019.286620:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582936960 00000100:00100000:3.0:1784044019.286675:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 136 00000100:00100000:3.0:1784044019.286684:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+9:6040:x1870705582936960:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784044019.286993:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+9:6040:x1870705582936960:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 308us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.287010:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 136 00000100:00100000:0.0:1784044019.290950:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044019.291313:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582937088 00000100:00100000:3.0:1784044019.291324:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582937088 00000100:00100000:3.0:1784044019.291654:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 137 00000100:00100000:3.0:1784044019.291666:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5567:x1870705582937088:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044019.291683:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044019.291700:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1679400/0x9cc73983a7550043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead598 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.291728:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1679400/0x9cc73983a7550043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead598 expref: 10 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.291741:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1679400/0x9cc73983a7550043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead598 expref: 10 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.291769:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1679400, rc 0) 00000100:00100000:3.0:1784044019.291898:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5567:x1870705582937088:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 234us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.291906:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 137 00000100:00100000:0.0:1784044019.293985:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 10000000:01000000:1.0:1784044019.294068:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784044019.294073:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904bffcb1000 from 39 10000000:01000000:1.0:1784044019.294077:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784044019.294119:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.294131:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.294143:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044019.294166:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598688512:0@lo:101: 00000100:00100000:1.0:1784044019.294212:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.294261:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.294322:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582937216 00000100:00100000:0.0:1784044019.294329:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582937216 00000100:00100000:0.0:1784044019.294388:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598688512 00000100:00100000:0.0:1784044019.294392:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598688512 00000100:00100000:0.0:1784044019.294417:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 138 00000100:00100000:0.0:1784044019.294426:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5567:x1870705582937216:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044019.294553:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784044019.294572:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+12:5766:x1870705598688512:12345-0@lo:101: 00010000:00010000:3.0:1784044019.294580:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044019.294593:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1678400/0x9cc73983a7550051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755004a expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.294612:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1678400/0x9cc73983a7550051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755004a expref: 13 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.294622:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1678400/0x9cc73983a7550051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755004a expref: 13 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.294630:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1678400, rc 0) 00000100:00100000:0.0:1784044019.294705:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5567:x1870705582937216:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 279us (729us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044019.294852:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598688512:12345-0@lo:101: Request processed in 287us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.294902:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784044019.295425:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 138 00000100:00100000:1.0:1784044019.295515:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598688512:0@lo:101: 00010000:00010000:1.0:1784044019.295534:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.295975:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044019.296049:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598688640:0@lo:501: 00000100:00100000:1.0:1784044019.296087:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.296155:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598688640 00000100:00100000:2.0:1784044019.296161:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598688640 00000100:00100000:1.0:1784044019.296182:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044019.296207:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784044019.296216:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598688640:12345-0@lo:501: 00000100:00100000:2.0:1784044019.296448:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598688640:12345-0@lo:501: Request processed in 233us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044019.296455:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784044019.296684:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598688640:0@lo:501: 00000100:00100000:1.0:1784044019.296713:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598688768:0@lo:503: 00000100:00100000:1.0:1784044019.296749:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.296763:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.296820:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598688768 00000100:00100000:3.0:1784044019.296825:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598688768 00000100:00100000:3.0:1784044019.296856:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784044019.296879:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598688768:12345-0@lo:503: 00000100:00100000:3.0:1784044019.297070:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598688768:12345-0@lo:503: Request processed in 205us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.297087:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784044019.297177:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598688768:0@lo:503: 00000100:00100000:3.0:1784044019.297683:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8304:1870705598688896:0@lo:502: 00000100:00100000:3.0:1784044019.297722:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044019.297753:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc80f06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.297809:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598688896 00000100:00100000:0.0:1784044019.297814:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598688896 00000100:00100000:0.0:1784044019.297851:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784044019.297859:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:8304:x1870705598688896:12345-0@lo:502: 00000100:00100000:0.0:1784044019.298183:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:8304:x1870705598688896:12345-0@lo:502: Request processed in 324us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.298191:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784044019.298254:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8304:1870705598688896:0@lo:502: 00000100:00100000:3.0:1784044019.298294:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8304:1870705598689024:0@lo:502: 00000100:00100000:3.0:1784044019.298324:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044019.298455:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc80f06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.298551:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598689024 00000100:00100000:0.0:1784044019.298555:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598689024 00000100:00100000:0.0:1784044019.298642:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784044019.298650:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:8304:x1870705598689024:12345-0@lo:502: 00000100:00100000:0.0:1784044019.298797:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:8304:x1870705598689024:12345-0@lo:502: Request processed in 148us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.298804:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784044019.298929:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8304:1870705598689024:0@lo:502: 00000040:00080000:3.0:1784044019.298950:0:8304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784044019.299118:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784044019.299141:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784044019.299151:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.299162:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044019.299172:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784044019.299175:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1784044019.299178:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784044019.299206:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.299214:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.299232:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044019.299247:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598689152:0@lo:101: 00000100:00100000:1.0:1784044019.299279:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.299344:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.299448:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598689152 00000100:00100000:0.0:1784044019.299452:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598689152 00000100:00100000:0.0:1784044019.299555:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784044019.299563:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+13:5766:x1870705598689152:12345-0@lo:101: 00010000:00010000:0.0:1784044019.299666:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044019.299678:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904c02177000/0x9cc73983a755005f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7550058 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.299700:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904c02177000/0x9cc73983a755005f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7550058 expref: 14 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.299709:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904c02177000/0x9cc73983a755005f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7550058 expref: 14 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.299717:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904c02177000, rc 0) 00000100:00100000:0.0:1784044019.299792:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598689152:12345-0@lo:101: Request processed in 229us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.299798:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784044019.299857:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598689152:0@lo:101: 00010000:00010000:1.0:1784044019.300014:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.300023:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044019.300073:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598689280:0@lo:501: 00000100:00100000:1.0:1784044019.300099:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.300124:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.300169:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598689280 00000100:00100000:3.0:1784044019.300174:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598689280 00000100:00100000:3.0:1784044019.300207:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784044019.300214:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598689280:12345-0@lo:501: 00000100:00100000:3.0:1784044019.300477:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598689280:12345-0@lo:501: Request processed in 253us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.300485:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784044019.300716:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598689280:0@lo:501: 00000100:00100000:1.0:1784044019.300742:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598689408:0@lo:503: 00000100:00100000:1.0:1784044019.300779:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.300800:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.300858:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598689408 00000100:00100000:0.0:1784044019.300888:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598689408 00000100:00100000:0.0:1784044019.300923:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784044019.300930:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598689408:12345-0@lo:503: 00000100:00100000:0.0:1784044019.301075:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598689408:12345-0@lo:503: Request processed in 145us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.301082:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784044019.301163:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598689408:0@lo:503: 00000100:00100000:1.0:1784044019.301522:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8305:1870705598689536:0@lo:502: 00000100:00100000:1.0:1784044019.301559:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.301592:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.301729:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598689536 00000100:00100000:0.0:1784044019.301734:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598689536 00000100:00100000:0.0:1784044019.301767:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784044019.301774:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:8305:x1870705598689536:12345-0@lo:502: 00000100:00100000:0.0:1784044019.301940:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:8305:x1870705598689536:12345-0@lo:502: Request processed in 165us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.301947:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784044019.302036:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8305:1870705598689536:0@lo:502: 00000020:01000000:1.0:1784044019.302065:0:8305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044019.302073:0:8305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044019.302075:0:8305:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784044019.302083:0:8305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784044019.302103:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8305:1870705598689664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044019.302134:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.302163:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5fd23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.302229:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598689664 00000100:00100000:3.0:1784044019.302232:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598689664 00000100:00100000:3.0:1784044019.302273:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784044019.302281:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:8305:x1870705598689664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044019.302428:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:8305:x1870705598689664:12345-0@lo:502:llog_process_th.0 Request processed in 147us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.302434:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784044019.302795:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8305:1870705598689664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044019.302815:0:8305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044019.302820:0:8305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044019.302822:0:8305:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784044019.302826:0:8305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1784044019.303210:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1784044019.303229:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784044019.303238:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044019.303250:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044019.303260:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784044019.303262:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904beee0a000 from 39 10000000:01000000:2.0:1784044019.303265:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784044019.303290:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044019.303304:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044019.303311:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044019.303324:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598689792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044019.303439:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044019.303637:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598689792 00000100:00100000:3.0:1784044019.303650:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598689792 00000100:00100000:3.0:1784044019.303689:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784044019.303697:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:5766:x1870705598689792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044019.303708:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044019.303720:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1679c00/0x9cc73983a755006d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7550066 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.303739:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1679c00/0x9cc73983a755006d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7550066 expref: 15 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.303749:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1679c00/0x9cc73983a755006d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7550066 expref: 15 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.303756:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1679c00, rc 0) 00000100:00100000:3.0:1784044019.303781:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598689792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.303787:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784044019.303832:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044019.303848:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598689792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044019.303860:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044019.303909:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044019.303957:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598689920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044019.303982:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.303992:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044019.304060:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598689920 00000100:00100000:1.0:1784044019.304065:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598689920 00000100:00100000:1.0:1784044019.304090:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784044019.304096:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598689920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044019.304329:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598689920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044019.304336:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784044019.304452:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598689920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044019.304694:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598690048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044019.304731:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.304752:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.304795:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598690048 00000100:00100000:3.0:1784044019.304799:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598690048 00000100:00100000:3.0:1784044019.304831:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784044019.304838:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598690048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044019.305013:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598690048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.305020:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784044019.305111:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598690048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044019.305506:0:8306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8306:1870705598690176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044019.305754:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.305781:0:8306:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.305805:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598690176 00000100:00100000:3.0:1784044019.305810:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598690176 00000100:00100000:3.0:1784044019.305846:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784044019.305853:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:8306:x1870705598690176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044019.306070:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:8306:x1870705598690176:12345-0@lo:502:llog_process_th.0 Request processed in 217us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.306082:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784044019.306148:0:8306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8306:1870705598690176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044019.306189:0:8306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8306:1870705598690304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044019.306225:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.306247:0:8306:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044019.306275:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598690304 00000100:00100000:1.0:1784044019.306280:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598690304 00000100:00100000:1.0:1784044019.306312:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784044019.306319:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:8306:x1870705598690304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044019.306551:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:8306:x1870705598690304:12345-0@lo:502:llog_process_th.0 Request processed in 231us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044019.306557:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784044019.306703:0:8306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8306:1870705598690304:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784044019.306723:0:8306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784044019.306928:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784044019.306953:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784044019.306962:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.306973:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044019.306982:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784044019.306985:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1784044019.306988:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784044019.307011:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.307019:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.307028:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044019.307043:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598690432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044019.307068:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.307089:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5fd2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.307218:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598690432 00000100:00100000:0.0:1784044019.307223:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598690432 00000100:00100000:0.0:1784044019.307251:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784044019.307258:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:5766:x1870705598690432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044019.307268:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044019.307280:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904c02176200/0x9cc73983a755007b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7550074 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.307298:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904c02176200/0x9cc73983a755007b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7550074 expref: 16 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.307307:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904c02176200/0x9cc73983a755007b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7550074 expref: 16 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.307315:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904c02176200, rc 0) 00000100:00100000:2.0:1784044019.307439:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598690432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044019.307450:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044019.307458:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044019.307509:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598690560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044019.307541:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598690432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 283us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.307547:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784044019.307744:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.307805:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.307837:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598690560 00000100:00100000:3.0:1784044019.307841:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598690560 00000100:00100000:0.0:1784044019.308014:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784044019.308023:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598690560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044019.308298:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598690560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.308306:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784044019.308641:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598690560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044019.308690:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598690688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044019.308731:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.308795:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.309186:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598690688 00000100:00100000:3.0:1784044019.309192:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598690688 00000100:00100000:1.0:1784044019.309295:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784044019.309306:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598690688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044019.309552:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598690688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044019.309560:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784044019.309843:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598690688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044019.310189:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8307:1870705598690816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044019.310232:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.310392:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.310512:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598690816 00000100:00100000:0.0:1784044019.310517:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598690816 00000100:00100000:0.0:1784044019.310544:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784044019.310551:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:8307:x1870705598690816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044019.310743:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:8307:x1870705598690816:12345-0@lo:502:llog_process_th.0 Request processed in 191us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.310757:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784044019.310965:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8307:1870705598690816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044019.310989:0:8307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044019.310998:0:8307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044019.311000:0:8307:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784044019.311004:0:8307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784044019.311025:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8307:1870705598690944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044019.311056:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.311066:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.311117:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598690944 00000100:00100000:0.0:1784044019.311122:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598690944 00000100:00100000:0.0:1784044019.311141:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784044019.311147:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:8307:x1870705598690944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044019.311299:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:8307:x1870705598690944:12345-0@lo:502:llog_process_th.0 Request processed in 151us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.311306:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784044019.311704:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8307:1870705598690944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044019.311723:0:8307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044019.311728:0:8307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044019.311730:0:8307:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784044019.311733:0:8307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1784044019.312045:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1784044019.312065:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784044019.312082:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.312094:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044019.312104:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784044019.312107:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904bc9af1000 from 39 10000000:01000000:1.0:1784044019.312110:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784044019.312136:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.312145:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.312155:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044019.312172:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044019.312210:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.312275:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5fd2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.312306:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598691072 00000100:00100000:0.0:1784044019.312311:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598691072 00000100:00100000:0.0:1784044019.312450:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784044019.312459:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598691072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044019.312533:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044019.312548:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904c02177a00/0x9cc73983a7550089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7550082 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.312628:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904c02177a00/0x9cc73983a7550089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7550082 expref: 17 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.312639:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904c02177a00/0x9cc73983a7550089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7550082 expref: 17 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.312647:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904c02177a00, rc 0) 00000100:00100000:0.0:1784044019.312687:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598691072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.312695:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784044019.312755:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044019.312770:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.312780:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044019.312828:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044019.312895:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.313140:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5fd2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.313193:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598691200 00000100:00100000:3.0:1784044019.313198:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598691200 00000100:00100000:3.0:1784044019.313224:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784044019.313231:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598691200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044019.313599:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598691200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.313607:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784044019.313779:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044019.313813:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044019.313850:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.313935:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5fd2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.314165:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598691328 00000100:00100000:3.0:1784044019.314170:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598691328 00000100:00100000:3.0:1784044019.314205:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784044019.314212:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598691328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044019.314777:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598691328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 564us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.314785:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784044019.315044:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044019.315531:0:8308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8308:1870705598691456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044019.315640:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.315712:0:8308:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.315745:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598691456 00000100:00100000:0.0:1784044019.315757:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598691456 00000100:00100000:0.0:1784044019.315831:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784044019.315839:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:8308:x1870705598691456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044019.316200:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:8308:x1870705598691456:12345-0@lo:502:llog_process_th.0 Request processed in 360us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.316208:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784044019.316423:0:8308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8308:1870705598691456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044019.316480:0:8308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8308:1870705598691584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044019.316515:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.316679:0:8308:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044019.316709:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598691584 00000100:00100000:2.0:1784044019.316714:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598691584 00000100:00100000:2.0:1784044019.316747:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784044019.316755:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:8308:x1870705598691584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044019.316964:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:8308:x1870705598691584:12345-0@lo:502:llog_process_th.0 Request processed in 209us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044019.316971:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784044019.317110:0:8308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8308:1870705598691584:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784044019.317130:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1784044019.317292:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1784044019.317313:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784044019.317324:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.317335:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044019.317362:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784044019.317365:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1784044019.317367:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784044019.317392:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.317401:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.317420:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044019.317435:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044019.317464:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044019.317502:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff67a780 going to sleep for 11 seconds 00000100:00100000:1.0:1784044019.317705:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598691712 00000100:00100000:1.0:1784044019.317710:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598691712 00000100:00100000:1.0:1784044019.317744:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784044019.317751:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598691712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044019.317762:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044019.317775:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1662c00/0x9cc73983a7550097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7550090 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.317796:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1662c00/0x9cc73983a7550097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7550090 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.317806:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1662c00/0x9cc73983a7550097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7550090 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044019.317821:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662c00, rc 0) 00000100:00100000:1.0:1784044019.317853:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598691712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044019.317859:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784044019.318077:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044019.318090:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.318100:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044019.318147:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044019.318172:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044019.318201:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff67a780 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.318214:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598691840 00000100:00100000:3.0:1784044019.318218:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598691840 00000100:00100000:3.0:1784044019.318322:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784044019.318329:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598691840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044019.318843:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598691840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 512us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.318852:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784044019.318945:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044019.318978:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044019.319016:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044019.319038:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff56ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044019.319144:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598691968 00000100:00100000:1.0:1784044019.319150:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598691968 00000100:00100000:1.0:1784044019.319187:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784044019.319194:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598691968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044019.319833:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598691968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044019.319856:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598691968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 662us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044019.319893:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784044019.322545:0:8309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8309:1870705598692096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044019.322646:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044019.322690:0:8309:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff67a240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044019.322772:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598692096 00000100:00100000:0.0:1784044019.322780:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598692096 00000100:00100000:0.0:1784044019.323138:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784044019.323148:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:8309:x1870705598692096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044019.325030:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:8309:x1870705598692096:12345-0@lo:502:llog_process_th.0 Request processed in 1876us (2377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044019.325044:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1784044019.325101:0:8309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8309:1870705598692096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044019.325140:0:8309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044019.325150:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044019.325153:0:8309:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784044019.325171:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784044019.325208:0:8309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8309:1870705598692224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044019.325268:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044019.325304:0:8309:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff67a240 going to sleep for 11 seconds 00000100:00100000:1.0:1784044019.325315:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598692224 00000100:00100000:1.0:1784044019.325321:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598692224 00000100:00100000:1.0:1784044019.325365:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1784044019.325373:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:8309:x1870705598692224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044019.326173:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:8309:x1870705598692224:12345-0@lo:502:llog_process_th.0 Request processed in 796us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044019.326183:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784044019.326676:0:8309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8309:1870705598692224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044019.326707:0:8309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044019.326714:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044019.326717:0:8309:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784044019.326730:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1784044019.327158:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1784044019.327181:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784044019.327192:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.327257:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044019.327280:0:5766:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784044019.327281:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff904bd40e4d40 from 1 10000000:01000000:0.0:1784044019.327283:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784044019.327311:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904c02176a00/0x9cc73983a755009e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.327317:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904c02176a00/0x9cc73983a755009e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.327324:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904c02176a00/0x9cc73983a755009e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044019.327339:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598692352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044019.327384:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044019.328298:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598692352 00000100:00100000:0.0:1784044019.328298:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff56c480 going to sleep for 11 seconds 00000100:00100000:3.0:1784044019.328307:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598692352 00000100:00100000:3.0:1784044019.328400:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784044019.328420:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598692352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044019.328434:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044019.328457:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1678e00/0x9cc73983a75500a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755009e expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.328486:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1678e00/0x9cc73983a75500a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755009e expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.328497:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1678e00/0x9cc73983a75500a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755009e expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.328507:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1678e00, rc 0) 00000100:00100000:3.0:1784044019.328557:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598692352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.328573:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784044019.328645:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598692352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044019.328660:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904c02176a00/0x9cc73983a755009e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500a5 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044019.328669:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904c02176a00/0x9cc73983a755009e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75500a5 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044019.328740:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598692480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044019.328767:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044019.329341:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598692480 00000100:00100000:0.0:1784044019.329359:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff56c480 going to sleep for 11 seconds 00000100:00100000:2.0:1784044019.329369:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598692480 00000100:00100000:2.0:1784044019.329403:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784044019.329421:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598692480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044019.331402:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598692480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1967us (2619us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784044019.331426:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784044019.331473:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598692480:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784044019.331514:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784044019.331525:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904c02176a00/0x9cc73983a755009e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500a5 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044019.331535:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904c02176a00/0x9cc73983a755009e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500a5 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044019.550081:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044019.579132:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044019.579174:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044019.579228:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044019.579312:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582937344 00000100:00100000:1.0:1784044019.579322:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582937344 00000100:00100000:2.0:1784044019.579356:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582937600 00000100:00100000:2.0:1784044019.579363:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582937600 00000100:00100000:2.0:1784044019.579412:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582937472 00000100:00100000:1.0:1784044019.579418:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:2.0:1784044019.579419:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582937472 00000100:00100000:2.0:1784044019.579443:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1784044019.579454:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582937600:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044019.579458:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784044019.579470:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1784044019.579489:0:6569:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784044019.579500:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1784044019.579510:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582937472:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044019.579563:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582937472:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 54us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044019.579581:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044019.579912:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582937344:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044019.579948:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582937344:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 518us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044019.579955:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00080000:0.0:1784044019.580043:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044019.580047:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044019.580050:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044019.580138:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582937600:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 685us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044019.580146:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00010000:00010000:2.0:1784044020.574143:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044020.645539:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598692608:0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.645614:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044020.645675:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598693120:0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.645704:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044020.645734:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044020.645740:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598692992:0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.645766:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044020.645799:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598692736:0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.645824:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044020.645861:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598693248:0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.645921:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044020.645942:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044020.645947:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598692864:0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.645984:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044020.646024:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598692608 00000100:00100000:2.0:1784044020.646032:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598692608 00000100:00100000:2.0:1784044020.646087:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784044020.646110:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598692608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.646174:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598692608:12345-0@lo:400:kworker.0 Request processed in 78us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.646183:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784044020.646217:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598693120 00000100:00100000:2.0:1784044020.646220:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598693120 00000100:00100000:2.0:1784044020.646252:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598692736 00000100:00100000:2.0:1784044020.646255:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598692736 00000100:00100000:2.0:1784044020.646266:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598692864 00000100:00100000:2.0:1784044020.646269:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598692864 00000100:00100000:2.0:1784044020.646283:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784044020.646289:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598693120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.646323:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598693120:12345-0@lo:400:kworker.0 Request processed in 34us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.646329:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784044020.646340:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784044020.646346:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598692736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.646368:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598692736:12345-0@lo:400:kworker.0 Request processed in 23us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.646396:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784044020.646572:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598692608:0@lo:400:kworker.0 00000100:00100000:3.0:1784044020.646589:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598693120:0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.647250:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784044020.647262:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598692864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.647314:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598692864:12345-0@lo:400:kworker.0 Request processed in 56us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.647320:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784044020.647345:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598692992 00000100:00100000:2.0:1784044020.647351:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598692992 00000100:00100000:2.0:1784044020.647393:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598693248 00000100:00100000:2.0:1784044020.647397:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598693248 00000100:00100000:2.0:1784044020.647421:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044020.647428:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598692992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.647482:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598692992:12345-0@lo:400:kworker.0 Request processed in 55us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.647488:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044020.647500:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044020.647506:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598693248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.647534:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598693248:12345-0@lo:400:kworker.0 Request processed in 29us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.647540:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044020.647571:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598693376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044020.647603:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044020.648964:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044020.648973:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044020.648977:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044020.649690:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598692864:0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.649708:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598692736:0@lo:400:kworker.0 00010000:00080000:2.0:1784044020.649722:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0233b80 x1870705598693248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044020.649739:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598693248:0@lo:400:kworker.0 00010000:00080000:2.0:1784044020.649792:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0231880 x1870705598692992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044020.649801:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598692992:0@lo:400:kworker.0 00000100:00100000:2.0:1784044020.649828:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598693376 00000100:00100000:2.0:1784044020.649833:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598693376 00000100:00100000:2.0:1784044020.649890:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044020.649907:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598693376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044020.649941:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044020.655172:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598693376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5267us (7560us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.655190:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1784044020.655256:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffcaea00 x1870705598693376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044020.655280:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598693376:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1784044020.725574:0:8348:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe634f8820 20000000:00000080:3.0:1784044020.725591:0:8348:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff904bf58b9000 uarg=0000000000000000 20000000:01000000:3.0:1784044020.725629:0:8348:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784044020.725635:0:8348:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784044020.725641:0:8348:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784044020.726587:0:8349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1784044020.726753:0:8348:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1784044020.741881:0:8348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1784044020.742005:0:8348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1784044020.742078:0:8348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1784044020.742103:0:8348:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784044020.742123:0:8348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.742142:0:8348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc81f4200/0x9cc73983a754fe21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe1a expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.742151:0:8348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc81f4000/0x9cc73983a754fe83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754fe7c expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.742158:0:8348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc81f4a00/0x9cc73983a754ff4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a754ff47 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.742168:0:8348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc0030200/0x9cc73983a755000b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead560 expref: 9 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.742189:0:8348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.742231:0:8348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc0030200/0x9cc73983a755000b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead560 expref: 9 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.742261:0:8348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904bc0030200/0x9cc73983a755000b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead560 expref: 9 pid: 5762 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044020.742278:0:8348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcadc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8348:1870705598693504:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044020.742407:0:8348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc81f4a00/0x9cc73983a754ff4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754ff47 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.742416:0:8348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc81f4a00/0x9cc73983a754ff4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754ff47 expref: 18 pid: 5762 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044020.742426:0:8348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8348:1870705598693632:0@lo:104: 00000100:00100000:3.0:1784044020.744131:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044020.744357:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598693632 00000100:00100000:1.0:1784044020.744367:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598693632 00000100:00100000:1.0:1784044020.744437:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044020.744449:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:8348:x1870705598693632:12345-0@lo:104: 00010000:00010000:1.0:1784044020.744465:0:6585:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044020.744529:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1784044020.744555:0:8348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc81f4000/0x9cc73983a754fe83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fe7c expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.744567:0:8348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc81f4000/0x9cc73983a754fe83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fe7c expref: 18 pid: 5764 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044020.744579:0:8348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8348:1870705598693760:0@lo:104: 00000100:00100000:3.0:1784044020.744612:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044020.744651:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:8348:x1870705598693632:12345-0@lo:104: Request processed in 194us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044020.744659:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1784044020.745374:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044020.745392:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.745403:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1679600 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044020.745407:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.745416:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044020.745437:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044020.745442:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044020.745535:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.745542:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044020.745563:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.745571:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a754ff47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754ff4e expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.745583:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044020.745585:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044020.745586:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044020.745601:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598693888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044020.745643:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044020.745692:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598693888 00000100:00100000:2.0:1784044020.745700:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598693888 00010000:00010000:2.0:1784044020.745726:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc81f4a00/0x9cc73983a754ff4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff47 expref: 19 pid: 5762 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044020.745754:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784044020.745762:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0233b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598693888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044020.745773:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044020.745778:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc81f4a00/0x9cc73983a754ff4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754ff47 expref: 19 pid: 5762 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.745794:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc81f4a00/0x9cc73983a754ff4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754ff47 expref: 19 pid: 5762 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.745811:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044020.745987:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0233b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598693888:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.745994:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784044020.746030:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598693888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044020.747125:0:8348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc81f4200/0x9cc73983a754fe21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a754fe1a expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.747153:0:8348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc81f4200/0x9cc73983a754fe21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a754fe1a expref: 18 pid: 5764 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044020.747167:0:8348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8348:1870705598694016:0@lo:104: 00000100:00100000:3.0:1784044020.747206:0:8348:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff67ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1784044020.747226:0:8348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f4a00/0x9cc73983a754ff4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754ff47 expref: 18 pid: 5762 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044020.747250:0:8348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8348:1870705598693632:0@lo:104: 00000100:00100000:1.0:1784044020.747941:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784044020.748085:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044020.748103:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598693760 00000100:00100000:1.0:1784044020.748109:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598693760 00000100:00100000:1.0:1784044020.748142:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598694016 00000100:00100000:1.0:1784044020.748145:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598694016 00000100:00100000:1.0:1784044020.748159:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044020.748168:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf566f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:8348:x1870705598693760:12345-0@lo:104: 00000100:00100000:3.0:1784044020.748352:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044020.748405:0:8348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcadc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8348:1870705598693504:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044020.749426:0:5753:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:2.0:1784044020.749442:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784044020.749465:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:8348:x1870705598694016:12345-0@lo:104: 00010000:00010000:2.0:1784044020.749482:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1663800/0x9cc73983a754fe1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.749559:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784044020.749565:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:8348:x1870705598694016:12345-0@lo:104: Request processed in 115us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.749572:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784044020.749612:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582937728 00000100:00100000:2.0:1784044020.749617:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582937728 00010000:00010000:2.0:1784044020.749642:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc0030200/0x9cc73983a755000b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead560 expref: 10 pid: 5762 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044020.749668:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:2.0:1784044020.749675:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582937728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044020.749685:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044020.749705:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc0030200/0x9cc73983a755000b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead560 expref: 10 pid: 5762 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.749717:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc0030200/0x9cc73983a755000b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead560 expref: 10 pid: 5762 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.749736:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc0030200/0x9cc73983a755000b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead560 expref: 10 pid: 5762 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.749755:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044020.749798:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f40c65c2-a2d0-42d6-a031-2092177c578a+9:2347:x1870705582937728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 123us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.749806:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:3.0:1784044020.749879:0:8348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8348:1870705598694016:0@lo:104: 00010000:00010000:2.0:1784044020.751000:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044020.751010:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1663800/0x9cc73983a754fe1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.751020:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044020.751025:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1663800/0x9cc73983a754fe1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.751033:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1663800/0x9cc73983a754fe1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044020.751041:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1663800/0x9cc73983a754fe1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044020.751047:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044020.751092:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1663800/0x9cc73983a754fe1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.751114:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044020.751139:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1663800/0x9cc73983a754fe1a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.751146:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1663800/0x9cc73983a754fe1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe21 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.751160:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044020.751162:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044020.751164:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044020.751180:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598694144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044020.751236:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044020.751482:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598694144 00000100:00100000:3.0:1784044020.751490:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598694144 00010000:00010000:3.0:1784044020.751517:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc81f4200/0x9cc73983a754fe21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fe1a expref: 18 pid: 5764 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044020.751550:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044020.751558:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:3291:x1870705598694144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044020.751570:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044020.751576:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc81f4200/0x9cc73983a754fe21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fe1a expref: 18 pid: 5764 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.751586:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc81f4200/0x9cc73983a754fe21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fe1a expref: 18 pid: 5764 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.751599:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f4200/0x9cc73983a754fe21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fe1a expref: 18 pid: 5764 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.751622:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044020.751667:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:3291:x1870705598694144:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044020.751674:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044020.751998:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598694144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044020.753590:0:6585:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044020.753920:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044020.753930:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf566f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:8348:x1870705598693760:12345-0@lo:104: Request processed in 5761us (9315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044020.753939:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044020.754011:0:8348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8348:1870705598693760:0@lo:104: 00010000:00010000:3.0:1784044020.754046:0:8348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.756065:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044020.756078:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.756089:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1679e00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044020.756094:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.756105:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044020.756112:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044020.756118:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044020.756188:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.756196:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044020.756222:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.756229:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a754fe7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a754fe83 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.756250:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044020.756252:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044020.756254:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044020.756270:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598694272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044020.756760:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044020.756976:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598694272 00000100:00100000:2.0:1784044020.756984:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598694272 00010000:00010000:2.0:1784044020.757018:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc81f4000/0x9cc73983a754fe83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fe7c expref: 17 pid: 5764 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044020.757057:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044020.757067:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:3288:x1870705598694272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044020.757081:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044020.757087:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc81f4000/0x9cc73983a754fe83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a754fe7c expref: 17 pid: 5764 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757098:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc81f4000/0x9cc73983a754fe83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a754fe7c expref: 17 pid: 5764 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757113:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f4000/0x9cc73983a754fe83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a754fe7c expref: 17 pid: 5764 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757130:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757149:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757168:0:8289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757175:0:8289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757182:0:8289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757188:0:8289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757193:0:8289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ac00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044020.757198:0:8289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757205:0:8289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757225:0:8289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044020.757236:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044020.757280:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:3288:x1870705598694272:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044020.757287:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1784044020.757419:0:8348:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.757430:0:8348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044020.757436:0:8348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bffa9ac00/0x9cc73983a75500ac lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044020.757805:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598694272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044021.150718:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044021.156629:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598694400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044021.156710:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044021.160034:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598694400 00000100:00100000:3.0:1784044021.160050:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598694400 00000100:00100000:2.0:1784044021.169553:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044021.169581:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598694400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044021.169622:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044021.169711:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598694400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (13001us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044021.169718:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1784044021.169997:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0231f80 x1870705598694400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044021.170020:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598694400:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1784044021.213936:0:5766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044021.213945:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bffcb1000 from 4 10000000:01000000:3.0:1784044021.213950:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044021.213999:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044021.214029:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044021.214041:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044021.214067:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598694528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044021.214135:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044021.214181:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff67ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044021.214265:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598694528 00000100:00100000:0.0:1784044021.214272:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598694528 00000100:00100000:0.0:1784044021.214324:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784044021.214333:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598694528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044021.214346:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044021.214359:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904c02177e00/0x9cc73983a75500ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a75500b3 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044021.214391:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904c02177e00/0x9cc73983a75500ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a75500b3 expref: 17 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044021.214401:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904c02177e00/0x9cc73983a75500ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75500b3 expref: 17 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044021.214410:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904c02177e00, rc 0) 00000100:00100000:0.0:1784044021.215420:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598694528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1083us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044021.215451:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784044021.220802:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598694528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044021.220832:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.220860:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044021.221001:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598694656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.221064:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.221104:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.221142:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598694656 00000100:00100000:1.0:1784044021.221148:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598694656 00000100:00100000:1.0:1784044021.221190:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784044021.221199:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598694656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.221483:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598694656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.221491:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784044021.221549:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598694656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.221577:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598694784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.221615:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.221631:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.221645:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598694784 00000100:00100000:1.0:1784044021.221649:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598694784 00000100:00100000:1.0:1784044021.221671:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1784044021.221677:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598694784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.221818:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598694784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.221825:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1784044021.221895:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598694784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.222065:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8368:1870705598694912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.222098:0:8368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.222116:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598694912 00000100:00100000:1.0:1784044021.222120:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598694912 00000100:00100000:1.0:1784044021.222142:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784044021.222148:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:8368:x1870705598694912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.222267:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:8368:x1870705598694912:12345-0@lo:502:llog_process_th.0 Request processed in 118us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.222275:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784044021.222311:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.222323:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8368:1870705598694912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044021.222343:0:8368:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044021.222353:0:8368:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044021.222355:0:8368:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784044021.222364:0:8368:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904bffcb1000 00000020:00000080:1.0:1784044021.222366:0:8368:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784044021.222449:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8368:1870705598695040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.222482:0:8368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.222501:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598695040 00000100:00100000:1.0:1784044021.222505:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598695040 00000100:00100000:1.0:1784044021.222527:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784044021.222533:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:8368:x1870705598695040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.222636:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:8368:x1870705598695040:12345-0@lo:502:llog_process_th.0 Request processed in 103us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.222644:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784044021.222676:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be032d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.222688:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8368:1870705598695040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044021.222705:0:8368:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044021.222710:0:8368:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044021.222711:0:8368:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784044021.222715:0:8368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784044021.222763:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784044021.222778:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044021.222788:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.222798:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044021.222808:0:5766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044021.222811:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904beee0a000 from 4 10000000:01000000:1.0:1784044021.222813:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044021.222836:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.222844:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.222853:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044021.222891:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598695168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.222917:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.222935:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.222947:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598695168 00000100:00100000:1.0:1784044021.222956:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598695168 00000100:00100000:1.0:1784044021.222978:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1784044021.222984:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598695168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044021.222993:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044021.223006:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1662200/0x9cc73983a75500c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a75500c1 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.223027:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1662200/0x9cc73983a75500c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a75500c1 expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.223038:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1662200/0x9cc73983a75500c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75500c1 expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.223047:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662200, rc 0) 00000100:00100000:1.0:1784044021.223075:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598695168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.223082:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1784044021.223113:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598695168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044021.223124:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.223132:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044021.223167:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598695296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.223189:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.223201:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.223212:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598695296 00000100:00100000:1.0:1784044021.223222:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598695296 00000100:00100000:1.0:1784044021.223244:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1784044021.223250:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598695296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.223437:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598695296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.223444:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1784044021.223476:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598695296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.223500:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598695424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.223534:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.223547:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.223558:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598695424 00000100:00100000:1.0:1784044021.223562:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598695424 00000100:00100000:1.0:1784044021.223582:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784044021.223588:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598695424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.223697:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598695424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.223704:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784044021.223740:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598695424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.223971:0:8369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8369:1870705598695552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.224002:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.224021:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598695552 00000100:00100000:1.0:1784044021.224024:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598695552 00000100:00100000:1.0:1784044021.224046:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784044021.224053:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:8369:x1870705598695552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.224168:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:8369:x1870705598695552:12345-0@lo:502:llog_process_th.0 Request processed in 115us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.224181:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784044021.224219:0:8369:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39c000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.224232:0:8369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8369:1870705598695552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044021.224251:0:8369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044021.224258:0:8369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044021.224261:0:8369:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784044021.224268:0:8369:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904beee0a000 00000020:00000080:1.0:1784044021.224270:0:8369:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784044021.224321:0:8369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8369:1870705598695680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.224353:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.227053:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598695680 00000100:00100000:1.0:1784044021.227064:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598695680 00000100:00100000:1.0:1784044021.227131:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784044021.227142:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:8369:x1870705598695680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.227388:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:8369:x1870705598695680:12345-0@lo:502:llog_process_th.0 Request processed in 247us (3033us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.227396:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784044021.239102:0:8369:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39c000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.239144:0:8369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8369:1870705598695680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044021.239184:0:8369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044021.239192:0:8369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044021.239194:0:8369:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784044021.239200:0:8369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784044021.240680:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1784044021.240708:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784044021.240719:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044021.240733:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044021.240746:0:5766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784044021.240748:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bc9af1000 from 4 10000000:01000000:0.0:1784044021.240751:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784044021.240793:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044021.240801:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044021.240811:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044021.240833:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598695808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044021.240907:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044021.240940:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff56ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.242582:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598695808 00000100:00100000:1.0:1784044021.242594:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598695808 00000100:00100000:1.0:1784044021.242652:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784044021.242662:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598695808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044021.242688:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044021.242705:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1663600/0x9cc73983a75500d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a75500cf expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.242731:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1663600/0x9cc73983a75500d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a75500cf expref: 19 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.242742:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1663600/0x9cc73983a75500d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75500cf expref: 19 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.242751:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663600, rc 0) 00000100:00100000:1.0:1784044021.242813:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598695808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.242820:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784044021.242901:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598695808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044021.242918:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044021.242928:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044021.243009:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598695936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.243040:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.243069:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.243096:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598695936 00000100:00100000:1.0:1784044021.243099:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598695936 00000100:00100000:1.0:1784044021.243121:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784044021.243127:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598695936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.243381:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598695936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.243389:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784044021.243420:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598695936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.243458:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598696064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.243495:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.243508:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.243519:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598696064 00000100:00100000:1.0:1784044021.243522:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598696064 00000100:00100000:1.0:1784044021.243542:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784044021.243547:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598696064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.243678:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598696064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.243685:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784044021.243722:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598696064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044021.243915:0:8372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8372:1870705598696192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.243950:0:8372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.243968:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598696192 00000100:00100000:1.0:1784044021.243971:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598696192 00000100:00100000:1.0:1784044021.243994:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784044021.244000:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:8372:x1870705598696192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.244122:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:8372:x1870705598696192:12345-0@lo:502:llog_process_th.0 Request processed in 121us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.244129:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784044021.244171:0:8372:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39c780 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.244184:0:8372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8372:1870705598696192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044021.244206:0:8372:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044021.244215:0:8372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044021.244218:0:8372:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784044021.244227:0:8372:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904bc9af1000 00000020:00000080:1.0:1784044021.244230:0:8372:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784044021.244641:0:8372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8372:1870705598696320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.244679:0:8372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.244701:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598696320 00000100:00100000:1.0:1784044021.244705:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598696320 00000100:00100000:1.0:1784044021.244734:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1784044021.244739:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:8372:x1870705598696320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044021.244886:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:8372:x1870705598696320:12345-0@lo:502:llog_process_th.0 Request processed in 146us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.244893:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1784044021.244929:0:8372:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39c780 going to sleep for 11 seconds 00000100:00100000:1.0:1784044021.244941:0:8372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:8372:1870705598696320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044021.244960:0:8372:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044021.244965:0:8372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044021.244967:0:8372:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784044021.244971:0:8372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784044021.248459:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784044021.248500:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044021.248512:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044021.248527:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044021.599055:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044022.010110:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044022.010215:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582937856 00000100:00100000:3.0:1784044022.010226:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582937856 00000100:00100000:3.0:1784044022.010289:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 187 00000100:00100000:3.0:1784044022.010299:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+9:5567:x1870705582937856:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044022.010317:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044022.010337:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9ba00/0x9cc73983a75500dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead59f expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044022.010376:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9ba00/0x9cc73983a75500dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead59f expref: 10 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044022.010402:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9ba00/0x9cc73983a75500dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead59f expref: 10 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044022.010411:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9ba00, rc 0) 00000100:00100000:3.0:1784044022.012464:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5567:x1870705582937856:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 2155us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044022.012476:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 187 00000100:00100000:3.0:1784044022.019726:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044022.019816:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582937984 00000100:00100000:1.0:1784044022.019825:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582937984 00000100:00100000:1.0:1784044022.019960:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 188 00000100:00100000:1.0:1784044022.019970:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5567:x1870705582937984:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044022.020245:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5567:x1870705582937984:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 275us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044022.020258:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 188 00000100:00100000:2.0:1784044022.024703:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044022.026617:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582938112 00000100:00100000:3.0:1784044022.026632:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582938112 00000100:00100000:3.0:1784044022.026754:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 189 00000100:00100000:3.0:1784044022.026765:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5567:x1870705582938112:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044022.027084:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:5567:x1870705582938112:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 320us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044022.027093:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 189 00000100:00100000:0.0:1784044022.030763:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044022.036861:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582938240 00000100:00100000:2.0:1784044022.036887:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582938240 00000100:00100000:2.0:1784044022.036953:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:2.0:1784044022.036964:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:6104:x1870705582938240:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044022.037252:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:6104:x1870705582938240:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 288us (6498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044022.037260:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:0.0:1784044022.044387:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044022.044592:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582938368 00000100:00100000:2.0:1784044022.044607:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582938368 00000100:00100000:2.0:1784044022.044705:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 191 00000100:00100000:2.0:1784044022.044717:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:6104:x1870705582938368:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044022.044999:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:6104:x1870705582938368:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 282us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044022.045008:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 191 00010000:00010000:2.0:1784044022.627309:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044023.647151:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044024.671536:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044024.708080:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044024.708127:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044024.708225:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582938496 00000100:00100000:3.0:1784044024.708235:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582938496 00000100:00100000:3.0:1784044024.708311:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 192 00000100:00100000:3.0:1784044024.708321:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582938496:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044024.708403:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582938496:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 83us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044024.708411:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 192 00000100:00100000:0.0:1784044024.709020:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044024.709265:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044024.709382:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582938624 00000100:00100000:3.0:1784044024.709388:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582938624 00000100:00100000:3.0:1784044024.709444:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:3.0:1784044024.709452:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582938624:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044024.709496:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582938624:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 46us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044024.709503:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00080000:3.0:1784044024.709520:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044024.714596:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582938752 00000100:00100000:1.0:1784044024.714612:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582938752 00000100:00100000:1.0:1784044024.714695:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582938880 00000100:00100000:1.0:1784044024.714699:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582938880 00000100:00100000:1.0:1784044024.714731:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1784044024.714741:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582938752:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044024.714823:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582938752:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 83us (6695us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044024.714831:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1784044024.714850:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1784044024.714858:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582938880:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044024.714916:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582938880:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 58us (5651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044024.714922:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00080000:0.0:1784044024.715300:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044024.715317:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784044025.701895:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044025.758625:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598696448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044025.758693:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044025.758794:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598696448 00000100:00100000:0.0:1784044025.758802:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598696448 00000100:00100000:0.0:1784044025.758856:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044025.758883:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598696448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044025.758916:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044025.758959:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598696448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044025.758966:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1784044025.758985:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784044025.759142:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5c4ce00 x1870705598696448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044025.759160:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598696448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044025.765885:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598696704:0@lo:400:kworker.0 00000100:00100000:1.0:1784044025.765954:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044025.765994:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044025.766171:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598696576:0@lo:400:kworker.0 00000100:00100000:0.0:1784044025.766206:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044025.766241:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598697088:0@lo:400:kworker.0 00000100:00100000:0.0:1784044025.766280:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044025.766310:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044025.766316:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598696960:0@lo:400:kworker.0 00000100:00100000:0.0:1784044025.766336:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044025.766366:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598696704 00000100:00100000:0.0:1784044025.766374:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598696704 00000100:00100000:0.0:1784044025.766432:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598696960 00000100:00100000:0.0:1784044025.766436:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598696960 00000100:00100000:0.0:1784044025.766481:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784044025.766489:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598696704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044025.766538:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598696704:12345-0@lo:400:kworker.0 Request processed in 49us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044025.766546:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784044025.766563:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784044025.766569:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598696960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044025.766601:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598696960:12345-0@lo:400:kworker.0 Request processed in 32us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044025.766607:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1784044025.766631:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044025.766657:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598696960:0@lo:400:kworker.0 00000100:00100000:2.0:1784044025.766936:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598696576 00000100:00100000:2.0:1784044025.766942:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598696576 00000100:00100000:2.0:1784044025.766973:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784044025.766987:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598696576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044025.767104:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598696576:12345-0@lo:400:kworker.0 Request processed in 118us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044025.767110:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784044025.767140:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598697088 00000100:00100000:2.0:1784044025.767144:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598697088 00000100:00100000:2.0:1784044025.767176:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784044025.767182:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598697088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044025.767380:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598697088:12345-0@lo:400:kworker.0 Request processed in 198us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044025.767387:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1784044025.767401:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044025.767418:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598696576:0@lo:400:kworker.0 00010000:00080000:2.0:1784044025.767431:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3b9c00 x1870705598697088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044025.767441:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598697088:0@lo:400:kworker.0 00000100:00100000:1.0:1784044025.767577:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598696832:0@lo:400:kworker.0 00000100:00100000:1.0:1784044025.767610:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044025.767649:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598696704:0@lo:400:kworker.0 00000100:00100000:1.0:1784044025.767676:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598696832 00000100:00100000:1.0:1784044025.767679:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598696832 00000100:00100000:1.0:1784044025.767712:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784044025.767718:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598696832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044025.767778:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598696832:12345-0@lo:400:kworker.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044025.767786:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1784044025.767807:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044025.767828:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598696832:0@lo:400:kworker.0 00000100:00100000:1.0:1784044026.270257:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598697216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044026.270351:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044026.270529:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598697216 00000100:00100000:2.0:1784044026.270537:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598697216 00000100:00100000:2.0:1784044026.270600:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784044026.270610:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598697216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044026.270648:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044026.270699:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598697216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044026.270706:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1784044026.270837:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0231f80 x1870705598697216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044026.270857:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598697216:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784044026.718485:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784044026.980959:0:8647:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1784044027.742290:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044028.766972:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044029.792265:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044029.828999:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044029.829052:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044029.829098:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044029.829138:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044029.829141:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582939008 00000100:00100000:1.0:1784044029.829157:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582939008 00000100:00100000:3.0:1784044029.829178:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582939136 00000100:00100000:3.0:1784044029.829188:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582939136 00000100:00100000:1.0:1784044029.829247:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:1.0:1784044029.829262:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2345:x1870705582939008:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044029.829276:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:3.0:1784044029.829288:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582939136:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044029.829377:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582939136:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044029.829386:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:1.0:1784044029.829402:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2345:x1870705582939008:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 141us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044029.829418:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:3.0:1784044029.829422:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582939264 00000100:00100000:3.0:1784044029.829428:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582939264 00000100:00100000:0.0:1784044029.829568:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582939392 00000100:00100000:0.0:1784044029.829573:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582939392 00000100:00100000:3.0:1784044029.829633:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:3.0:1784044029.829642:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582939264:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044029.829683:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582939264:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044029.829703:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:0.0:1784044029.834371:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:0.0:1784044029.834408:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582939392:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044029.834539:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582939392:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 152us (5400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044029.834548:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00080000:3.0:1784044029.835066:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044029.835074:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044029.835079:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784044030.814640:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044030.887356:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598697344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044030.887432:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044030.888656:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044030.888670:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598697728:0@lo:400:kworker.0 00000100:00100000:3.0:1784044030.888721:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044030.889478:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598697344 00000100:00100000:3.0:1784044030.889487:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598697344 00000100:00100000:3.0:1784044030.889558:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044030.889568:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598697344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044030.889607:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044030.889811:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598697344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 243us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044030.889820:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1784044030.889854:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044030.889906:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3bbb80 x1870705598697344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044030.889926:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598697344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044030.892459:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598697728 00000100:00100000:0.0:1784044030.892607:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598697728 00000100:00100000:0.0:1784044030.892699:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784044030.892711:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598697728:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784044030.892802:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044030.893066:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598697856:0@lo:400:kworker.0 00000100:00100000:1.0:1784044030.893073:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598697472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044030.894977:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044030.895064:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598697856 00000100:00100000:3.0:1784044030.895080:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598697856 00000100:00100000:3.0:1784044030.895136:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784044030.895146:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598697856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044030.895216:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598697856:12345-0@lo:400:kworker.0 Request processed in 72us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044030.895224:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1784044030.896339:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044030.896390:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598697856:0@lo:400:kworker.0 00000100:00100000:1.0:1784044030.897420:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044030.897477:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598697984:0@lo:400:kworker.0 00000100:00100000:1.0:1784044030.897523:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044030.897558:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044030.897566:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598697600:0@lo:400:kworker.0 00000100:00100000:1.0:1784044030.897590:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044030.897623:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598697472 00000100:00100000:1.0:1784044030.897629:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598697472 00000100:00100000:1.0:1784044030.897672:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1784044030.897681:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598697472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044030.897725:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598697472:12345-0@lo:400:kworker.0 Request processed in 46us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044030.897733:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1784044030.897774:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598697984 00000100:00100000:1.0:1784044030.897778:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598697984 00000100:00100000:1.0:1784044030.897815:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044030.897822:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598697984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044030.898451:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598697984:12345-0@lo:400:kworker.0 Request processed in 626us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044030.898459:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044030.898502:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598697600 00000100:00100000:1.0:1784044030.898507:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598697600 00000100:00100000:1.0:1784044030.898544:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784044030.898552:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598697600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044030.898594:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598697600:12345-0@lo:400:kworker.0 Request processed in 44us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044030.898600:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1784044030.898637:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044030.898663:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598697600:0@lo:400:kworker.0 00000100:00100000:1.0:1784044030.898674:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598697472:0@lo:400:kworker.0 00010000:00080000:1.0:1784044030.898696:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3bbb80 x1870705598697984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044030.898706:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598697984:0@lo:400:kworker.0 00000100:00100000:0.0:1784044030.902200:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598697728:12345-0@lo:400:kworker.0 Request processed in 9473us (13459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044030.902224:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784044030.902324:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598697728:0@lo:400:kworker.0 00000100:00100000:1.0:1784044031.392423:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044031.392451:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598698112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044031.392520:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044031.392590:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598698112 00000100:00100000:1.0:1784044031.392597:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598698112 00000100:00100000:1.0:1784044031.392659:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784044031.392668:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598698112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044031.392703:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044031.392748:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598698112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044031.392755:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1784044031.392796:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904beeef1500 x1870705598698112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044031.392813:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598698112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784044031.840378:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784044032.572143:0:8890:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing yml_node 00010000:00010000:2.0:1784044032.863041:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044033.888003:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044034.911284:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044034.942589:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044034.942635:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044034.942714:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582939520 00000100:00100000:1.0:1784044034.942724:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582939520 00000100:00100000:1.0:1784044034.942785:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 196 00000100:00100000:1.0:1784044034.942795:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582939520:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044034.942910:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582939520:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044034.942918:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 196 00000100:00100000:0.0:1784044034.943562:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582939648 00000100:00100000:0.0:1784044034.943568:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582939648 00000100:00100000:0.0:1784044034.943627:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:0.0:1784044034.943635:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582939648:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044034.943685:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582939648:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 51us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044034.943693:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00080000:1.0:1784044034.943754:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044034.951977:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044034.952063:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582939776 00000100:00100000:1.0:1784044034.952073:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582939776 00000100:00100000:1.0:1784044034.952162:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1784044034.952179:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2344:x1870705582939776:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:1.0:1784044034.952223:0:6571:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a7550019 00000100:00080000:1.0:1784044034.952241:0:6571:0:(import.c:65:import_set_state_nolock()) ffff904bc66f9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784044034.952284:0:6571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1784044034.952636:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+2:2344:x1870705582939776:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 465us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044034.952645:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00080000:3.0:1784044034.953264:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784044034.953344:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044034.956618:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044034.956707:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582939904 00000100:00100000:1.0:1784044034.956719:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582939904 00000100:00100000:1.0:1784044034.956800:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044034.956811:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2344:x1870705582939904:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:1.0:1784044034.956851:0:6569:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a7550020 00000100:00080000:1.0:1784044034.956861:0:6569:0:(import.c:65:import_set_state_nolock()) ffff904bc66fc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784044034.956943:0:6569:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1784044034.957305:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+2:2344:x1870705582939904:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 495us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044034.957314:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00010000:00010000:2.0:1784044034.957425:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044034.957592:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784044035.934181:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044035.998911:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598698240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044035.999003:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.999079:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598698240 00000100:00100000:2.0:1784044035.999102:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598698240 00000100:00100000:2.0:1784044035.999160:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784044035.999170:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598698240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044035.999211:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044035.999261:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598698240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.999269:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1784044035.999293:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784044035.999324:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0231880 x1870705598698240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044035.999342:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598698240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044036.005384:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598698624:0@lo:400:kworker.0 00000100:00100000:2.0:1784044036.005454:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044036.005494:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044036.005501:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598698496:0@lo:400:kworker.0 00000100:00100000:2.0:1784044036.005525:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044036.005559:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598698624 00000100:00100000:2.0:1784044036.005567:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598698624 00000100:00100000:2.0:1784044036.005625:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598698496 00000100:00100000:2.0:1784044036.005628:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598698496 00000100:00100000:3.0:1784044036.006083:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598698368:0@lo:400:kworker.0 00000100:00100000:3.0:1784044036.006137:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044036.006235:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598698880:0@lo:400:kworker.0 00000100:00100000:3.0:1784044036.006261:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044036.006281:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044036.006287:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598698752:0@lo:400:kworker.0 00000100:00100000:3.0:1784044036.006311:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044036.006353:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598698752 00000100:00100000:3.0:1784044036.006358:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598698752 00000100:00100000:1.0:1784044036.006684:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598698368 00000100:00100000:1.0:1784044036.006690:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598698368 00000100:00100000:1.0:1784044036.006724:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1784044036.006733:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598698368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044036.006924:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598698368:12345-0@lo:400:kworker.0 Request processed in 191us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044036.006941:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1784044036.006977:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598698880 00000100:00100000:1.0:1784044036.006981:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598698880 00000100:00100000:1.0:1784044036.007011:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044036.007018:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598698880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044036.007054:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784044036.007056:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598698880:12345-0@lo:400:kworker.0 Request processed in 38us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044036.007066:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784044036.007071:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598698624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044036.007124:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598698368:0@lo:400:kworker.0 00000100:00100000:2.0:1784044036.007132:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598698624:12345-0@lo:400:kworker.0 Request processed in 65us (1677us total) trans 0 rc 0/0 00010000:00080000:1.0:1784044036.007147:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0233800 x1870705598698880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044036.007160:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598698880:0@lo:400:kworker.0 00000100:00100000:3.0:1784044036.007898:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044036.007910:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598698496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044036.007968:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598698496:12345-0@lo:400:kworker.0 Request processed in 62us (2442us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044036.007976:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044036.007992:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784044036.007999:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598698752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044036.008031:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598698752:12345-0@lo:400:kworker.0 Request processed in 33us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044036.008037:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1784044036.008056:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044036.008061:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044036.008144:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598698496:0@lo:400:kworker.0 00000100:00100000:3.0:1784044036.008166:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598698624:0@lo:400:kworker.0 00000100:00100000:1.0:1784044036.008169:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598698752:0@lo:400:kworker.0 00000100:00100000:2.0:1784044036.008436:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784044036.511788:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044036.511905:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598699008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044036.511975:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044036.512040:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598699008 00000100:00100000:3.0:1784044036.512049:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598699008 00000100:00100000:3.0:1784044036.512107:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784044036.512115:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598699008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044036.513463:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044036.513552:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598699008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1434us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044036.513561:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1784044036.514530:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffcae300 x1870705598699008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044036.514694:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598699008:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1784044036.681771:0:9083:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00010000:00010000:2.0:1784044036.958061:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784044037.078474:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:1.0:1784044037.078486:0:6598:0:(genops.c:906:class_export_put()) final put ffff904bc66fe000/3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:0.0:1784044037.078555:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc66fe000/3609c122-577c-43fa-ab52-dd2c7dc5cce7 for lustre-OST0000 00000020:00000080:0.0:1784044037.078608:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bc66f9000 for lustre-OST0000 00010000:00010000:0.0:1784044037.983577:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784044038.126210:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:2.0:1784044038.126218:0:7484:0:(genops.c:906:class_export_put()) final put ffff904bc66fa800/3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:1.0:1784044038.126318:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc66fa800/3609c122-577c-43fa-ab52-dd2c7dc5cce7 for lustre-OST0001 00000020:00000080:1.0:1784044038.126374:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bc66fc000 for lustre-OST0001 00000001:02000400:0.0:1784044038.720081:0:9182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00010000:00010000:2.0:1784044039.008593:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044040.030350:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044040.063090:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044040.063155:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044040.063177:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582940160 00000100:00100000:2.0:1784044040.063231:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582940032 00000100:00100000:2.0:1784044040.063249:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582940032 00000100:00100000:2.0:1784044040.063328:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 198 00000100:00100000:2.0:1784044040.063342:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2348:x1870705582940032:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044040.063451:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2348:x1870705582940032:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044040.063459:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 198 00000100:00100000:3.0:1784044040.064041:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582940160 00000100:00080000:2.0:1784044040.066730:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044040.066896:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:3.0:1784044040.066925:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582940160:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044040.067410:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582940160:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 488us (4335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044040.067420:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000001:02000400:2.0:1784044040.859497:0:9279:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:2.0:1784044041.054076:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044041.118053:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044041.118076:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598699136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044041.118148:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044041.118234:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598699136 00000100:00100000:1.0:1784044041.118253:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598699136 00000100:00100000:1.0:1784044041.118307:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044041.118315:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598699136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044041.118348:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784044041.118370:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044041.118391:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598699136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044041.118410:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1784044041.118501:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0231c00 x1870705598699136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044041.118789:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598699136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044041.119567:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598699264:0@lo:400:kworker.0 00000100:00100000:3.0:1784044041.119617:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044041.119668:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598699776:0@lo:400:kworker.0 00000100:00100000:0.0:1784044041.119672:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598699648:0@lo:400:kworker.0 00000100:00100000:3.0:1784044041.119701:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044041.119701:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044041.119723:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044041.119729:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598699392:0@lo:400:kworker.0 00000100:00100000:3.0:1784044041.119764:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598699264 00000100:00100000:3.0:1784044041.119771:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598699264 00000100:00100000:3.0:1784044041.119808:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1784044041.119816:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598699264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044041.119859:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598699264:12345-0@lo:400:kworker.0 Request processed in 42us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044041.119897:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1784044041.119933:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598699776 00000100:00100000:3.0:1784044041.119937:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598699776 00000100:00100000:3.0:1784044041.119970:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784044041.119977:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598699776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044041.120019:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598699776:12345-0@lo:400:kworker.0 Request processed in 43us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044041.120025:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1784044041.120053:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044041.120335:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044041.120344:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598699520:0@lo:400:kworker.0 00000100:00100000:0.0:1784044041.120459:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044041.120490:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044041.120509:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598699648 00000100:00100000:3.0:1784044041.120515:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598699648 00000100:00100000:3.0:1784044041.120549:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598699520 00000100:00100000:3.0:1784044041.120552:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598699520 00010000:00080000:0.0:1784044041.120598:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5c4c000 x1870705598699776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044041.120612:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598699776:0@lo:400:kworker.0 00000100:00100000:0.0:1784044041.120621:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598699264:0@lo:400:kworker.0 00000100:00100000:0.0:1784044041.120699:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598699392 00000100:00100000:0.0:1784044041.120704:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598699392 00000100:00100000:3.0:1784044041.120795:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044041.121311:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598699648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044041.121372:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598699648:12345-0@lo:400:kworker.0 Request processed in 569us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044041.121380:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044041.122317:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044041.122445:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598699648:0@lo:400:kworker.0 00000100:00100000:0.0:1784044041.122851:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784044041.122861:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598699392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044041.122951:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598699392:12345-0@lo:400:kworker.0 Request processed in 91us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044041.122958:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784044041.125682:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598699520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044041.125786:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598699520:12345-0@lo:400:kworker.0 Request processed in 3460us (5327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044041.125795:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044041.126259:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598699392:0@lo:400:kworker.0 00000100:00080000:1.0:1784044041.127384:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044041.127443:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598699520:0@lo:400:kworker.0 00000100:00100000:2.0:1784044041.630309:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598699904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044041.630404:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044041.630476:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598699904 00000100:00100000:0.0:1784044041.630485:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598699904 00000100:00100000:0.0:1784044041.630550:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784044041.630561:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598699904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044041.630595:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044041.635636:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598699904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5066us (5220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044041.635651:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1784044041.643783:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffcace00 x1870705598699904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044041.643812:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598699904:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784044042.078413:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784044042.409716:0:9329:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jul 14 11:47:21 EDT 2026 00010000:00010000:2.0:1784044043.102246:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044044.126274:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044045.151262:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044045.181170:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044045.181211:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044045.181342:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582940288 00000100:00100000:1.0:1784044045.181424:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582940288 00000100:00100000:1.0:1784044045.181535:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 200 00000100:00100000:1.0:1784044045.181548:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2345:x1870705582940288:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044045.181567:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582940416 00000100:00100000:2.0:1784044045.181578:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582940416 00000100:00100000:1.0:1784044045.181627:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2345:x1870705582940288:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 82us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044045.181636:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 200 00000100:00100000:2.0:1784044045.181642:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1784044045.181653:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582940416:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044045.181692:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582940416:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044045.181699:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00080000:0.0:1784044045.184634:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784044046.174177:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044046.238201:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044046.238227:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598700032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044046.238301:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044046.242302:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598700288:0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.242357:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044046.242386:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044046.242391:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598700416:0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.242410:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044046.242436:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598700288 00000100:00100000:1.0:1784044046.242443:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598700288 00000100:00100000:1.0:1784044046.242485:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598700416 00000100:00100000:1.0:1784044046.242488:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598700416 00000100:00100000:1.0:1784044046.242517:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784044046.242526:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598700288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.242576:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598700288:12345-0@lo:400:kworker.0 Request processed in 50us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044046.242583:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784044046.242599:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044046.242605:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598700416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.242651:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598700416:12345-0@lo:400:kworker.0 Request processed in 47us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044046.242657:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1784044046.242681:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044046.242697:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598700544:0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.242721:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044046.242738:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784044046.242743:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598700160:0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.242769:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044046.242792:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598700672:0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.242814:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044046.242837:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598700160 00000100:00100000:1.0:1784044046.242840:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598700160 00000100:00100000:1.0:1784044046.243186:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1784044046.243195:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598700160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.243237:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598700160:12345-0@lo:400:kworker.0 Request processed in 44us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044046.243243:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1784044046.243270:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598700672 00000100:00100000:1.0:1784044046.243273:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598700672 00000100:00100000:1.0:1784044046.243301:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784044046.243307:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598700672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.243332:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598700672:12345-0@lo:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044046.243337:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1784044046.243355:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044046.243377:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598700416:0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.243386:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598700288:0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.243413:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598700544 00000100:00100000:1.0:1784044046.243415:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598700544 00000100:00100000:1.0:1784044046.243435:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784044046.243440:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598700544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044046.243464:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598700544:12345-0@lo:400:kworker.0 Request processed in 24us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044046.243469:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1784044046.243483:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044046.243625:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598700160:0@lo:400:kworker.0 00010000:00080000:3.0:1784044046.243641:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5441880 x1870705598700672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044046.243651:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598700672:0@lo:400:kworker.0 00000100:00100000:3.0:1784044046.243660:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598700544:0@lo:400:kworker.0 00000100:00100000:2.0:1784044046.245292:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598700032 00000100:00100000:2.0:1784044046.245303:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598700032 00000100:00100000:2.0:1784044046.245385:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784044046.245394:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598700032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044046.245428:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044046.245496:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598700032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (7196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044046.245502:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1784044046.247224:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784044046.247272:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0230e00 x1870705598700032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044046.247313:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598700032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044046.755876:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044046.755914:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598700800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044046.755990:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044046.756070:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598700800 00000100:00100000:3.0:1784044046.756077:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598700800 00000100:00100000:3.0:1784044046.756130:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044046.756139:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598700800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044046.756173:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044046.756229:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598700800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044046.756236:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1784044046.756439:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffcace00 x1870705598700800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044046.756459:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598700800:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784044047.200076:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044048.222103:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044049.246208:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044050.272849:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044050.299262:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044050.299320:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044050.300142:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582940672 00000100:00100000:1.0:1784044050.300152:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582940672 00000100:00100000:1.0:1784044050.300234:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:1.0:1784044050.300245:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705582940672:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044050.300318:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705582940672:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 76us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044050.300326:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:0.0:1784044050.300471:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582940544 00000100:00100000:0.0:1784044050.300476:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582940544 00000100:00100000:0.0:1784044050.300514:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 202 00000100:00100000:0.0:1784044050.300521:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2346:x1870705582940544:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044050.300575:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2346:x1870705582940544:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 54us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044050.300583:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 202 00000100:00080000:2.0:1784044050.300630:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784044051.294252:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044051.358168:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044051.358194:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598700928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044051.358237:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598701184:0@lo:400:kworker.0 00000100:00100000:2.0:1784044051.358267:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044051.358281:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044051.358347:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598701440:0@lo:400:kworker.0 00000100:00100000:1.0:1784044051.358355:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598701056:0@lo:400:kworker.0 00000100:00100000:0.0:1784044051.358387:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044051.358404:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044051.358457:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598701312:0@lo:400:kworker.0 00000100:00100000:2.0:1784044051.358485:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044051.358518:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598701184 00000100:00100000:2.0:1784044051.358526:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598701184 00000100:00100000:2.0:1784044051.358568:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598701312 00000100:00100000:2.0:1784044051.358572:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598701312 00000100:00100000:2.0:1784044051.358601:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784044051.358609:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598701184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044051.358670:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598701184:12345-0@lo:400:kworker.0 Request processed in 62us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044051.358678:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784044051.358697:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784044051.358703:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598701312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044051.358733:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598701312:12345-0@lo:400:kworker.0 Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044051.358739:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1784044051.358758:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044051.358784:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598701312:0@lo:400:kworker.0 00000100:00100000:2.0:1784044051.360968:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598700928 00000100:00100000:2.0:1784044051.360981:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598700928 00000100:00100000:2.0:1784044051.361055:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044051.361065:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598700928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044051.361106:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044051.361183:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598700928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044051.361204:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1784044051.361248:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0233800 x1870705598700928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044051.361269:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598700928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784044051.361359:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044051.361924:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598701056 00000100:00100000:0.0:1784044051.361930:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598701056 00000100:00100000:0.0:1784044051.361973:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784044051.361981:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598701056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044051.362031:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598701056:12345-0@lo:400:kworker.0 Request processed in 51us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044051.362039:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1784044051.362298:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598701184:0@lo:400:kworker.0 00000100:00100000:3.0:1784044051.362311:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598701696:0@lo:400:kworker.0 00000100:00100000:3.0:1784044051.362344:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044051.362396:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598701440 00000100:00100000:0.0:1784044051.362401:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598701440 00000100:00100000:3.0:1784044051.362408:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598701696 00000100:00100000:3.0:1784044051.362414:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598701696 00000100:00100000:0.0:1784044051.362447:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784044051.362456:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598701440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044051.362458:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784044051.362471:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598701696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044051.362507:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598701440:12345-0@lo:400:kworker.0 Request processed in 52us (4119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044051.362515:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044051.362521:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598701696:12345-0@lo:400:kworker.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044051.362530:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1784044051.362552:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffcaad80 x1870705598701440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044051.362564:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598701440:0@lo:400:kworker.0 00000100:00080000:3.0:1784044051.362569:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784044051.362592:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffca8000 x1870705598701696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044051.362620:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598701696:0@lo:400:kworker.0 00000100:00100000:1.0:1784044051.363005:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598701056:0@lo:400:kworker.0 00000100:00100000:1.0:1784044051.363016:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598701568:0@lo:400:kworker.0 00000100:00100000:1.0:1784044051.363049:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044051.363087:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598701568 00000100:00100000:2.0:1784044051.363093:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598701568 00000100:00100000:2.0:1784044051.363141:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784044051.363149:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598701568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044051.363186:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598701568:12345-0@lo:400:kworker.0 Request processed in 37us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044051.363192:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784044051.364727:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598701568:0@lo:400:kworker.0 00000100:00080000:3.0:1784044051.364910:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044051.870197:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044051.870224:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598701824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044051.870297:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044051.870470:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598701824 00000100:00100000:3.0:1784044051.870480:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598701824 00000100:00100000:3.0:1784044051.870541:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784044051.870551:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598701824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044051.870586:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044051.870638:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598701824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044051.870645:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1784044051.870684:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffca8000 x1870705598701824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044051.870702:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598701824:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784044052.320116:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044053.343000:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044054.366129:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044055.390324:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044055.421017:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044055.421068:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044055.421226:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582940800 00000100:00100000:1.0:1784044055.421236:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582940800 00000100:00100000:1.0:1784044055.421304:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 204 00000100:00100000:1.0:1784044055.421314:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582940800:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044055.421375:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582940928 00000100:00100000:0.0:1784044055.421381:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582940928 00000100:00100000:0.0:1784044055.421430:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:0.0:1784044055.421437:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582940928:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044055.421528:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705582940800:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 213us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044055.421540:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 204 00000100:00100000:0.0:1784044055.421541:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582940928:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 101us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044055.421551:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00080000:3.0:1784044055.421910:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784044056.423035:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044056.489342:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598701952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044056.489412:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044056.489484:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598701952 00000100:00100000:2.0:1784044056.489492:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598701952 00000100:00100000:2.0:1784044056.489556:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784044056.489565:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598701952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044056.489601:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044056.489645:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598701952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044056.489652:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1784044056.489673:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784044056.489711:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0233800 x1870705598701952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044056.489742:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598701952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044056.493935:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044056.493960:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598702080:0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494037:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044056.494092:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598702080 00000100:00100000:1.0:1784044056.494100:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598702080 00000100:00100000:1.0:1784044056.494147:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1784044056.494156:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598702080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494205:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598702080:12345-0@lo:400:kworker.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044056.494213:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1784044056.494262:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598702080:0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494297:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598702208:0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494320:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044056.494348:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598702208 00000100:00100000:1.0:1784044056.494352:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598702208 00000100:00100000:1.0:1784044056.494381:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784044056.494387:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598702208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494422:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598702208:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044056.494428:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784044056.494456:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598702208:0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494486:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598702336:0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494520:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044056.494548:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598702336 00000100:00100000:1.0:1784044056.494552:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598702336 00000100:00100000:1.0:1784044056.494584:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784044056.494589:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598702336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494618:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598702336:12345-0@lo:400:kworker.0 Request processed in 29us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044056.494624:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1784044056.494637:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044056.494655:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598702336:0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494681:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598702464:0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494718:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044056.494741:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598702464 00000100:00100000:1.0:1784044056.494744:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598702464 00000100:00100000:1.0:1784044056.494765:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784044056.494771:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598702464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494800:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598702464:12345-0@lo:400:kworker.0 Request processed in 30us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044056.494806:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1784044056.494818:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044056.494834:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598702464:0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494860:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044056.494890:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598702592:0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.494915:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044056.494941:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598702592 00000100:00100000:1.0:1784044056.494945:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598702592 00000100:00100000:1.0:1784044056.494984:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044056.494990:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598702592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044056.495023:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598702592:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044056.495029:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1784044056.495041:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784044056.495059:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5443100 x1870705598702592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044056.495070:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598702592:0@lo:400:kworker.0 00000001:02000400:1.0:1784044056.511209:0:9959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 11:47:35 (1784044055) === 00000100:00100000:0.0:1784044056.995432:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044056.995480:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598702720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044056.995604:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044056.995950:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598702720 00000100:00100000:2.0:1784044056.995962:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598702720 00000100:00100000:2.0:1784044056.996036:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784044056.996048:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598702720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044056.996102:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044056.996171:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598702720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044056.996189:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1784044056.997989:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffca8a80 x1870705598702720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044056.998025:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598702720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044057.033434:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044057.035085:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582941056 00000100:00100000:0.0:1784044057.035103:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582941056 00000100:00100000:0.0:1784044057.035197:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 206 00000100:00100000:0.0:1784044057.035210:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+10:8097:x1870705582941056:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784044057.035233:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044057.035257:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee7400/0x9cc73983a75500e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead5a6 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044057.035298:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee7400/0x9cc73983a75500e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5a6 expref: 11 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044057.035312:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee7400/0x9cc73983a75500e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5a6 expref: 11 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044057.035323:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7400, rc 0) 00000100:00100000:0.0:1784044057.035416:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+11:8097:x1870705582941056:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 208us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044057.035444:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 206 00000100:00100000:1.0:1784044057.042343:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044057.042476:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582941184 00000100:00100000:2.0:1784044057.042489:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582941184 00000100:00100000:2.0:1784044057.042565:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:2.0:1784044057.042579:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+11:8097:x1870705582941184:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784044057.043072:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+11:8097:x1870705582941184:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 492us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044057.043083:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:3.0:1784044057.045549:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044057.045643:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582941312 00000100:00100000:1.0:1784044057.045657:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582941312 00000100:00100000:1.0:1784044057.045754:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 208 00000100:00100000:1.0:1784044057.045767:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+11:8097:x1870705582941312:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784044057.046114:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+11:8097:x1870705582941312:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 348us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.046125:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 208 00000100:00100000:3.0:1784044057.049766:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044057.050323:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582941440 00000100:00100000:0.0:1784044057.050337:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582941440 00000100:00100000:0.0:1784044057.050405:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:0.0:1784044057.050417:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+11:8101:x1870705582941440:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044057.051233:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+11:8101:x1870705582941440:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 811us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044057.051243:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:3.0:1784044057.081605:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044057.089360:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582941568 00000100:00100000:2.0:1784044057.089383:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582941568 00000100:00100000:2.0:1784044057.089481:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 210 00000100:00100000:2.0:1784044057.089493:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+11:8101:x1870705582941568:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044057.090431:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+11:8101:x1870705582941568:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 934us (8836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044057.090442:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 210 00000100:00100000:3.0:1784044057.111192:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044057.111334:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582941696 00000100:00100000:0.0:1784044057.111352:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582941696 00000100:00100000:0.0:1784044057.111427:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:0.0:1784044057.111440:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+11:8097:x1870705582941696:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784044057.111463:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044057.111489:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee6000/0x9cc73983a75500eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead5d0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044057.111531:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee6000/0x9cc73983a75500eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d0 expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044057.111545:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee6000/0x9cc73983a75500eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d0 expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044057.111568:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6000, rc 0) 00000100:00100000:0.0:1784044057.111647:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+12:8097:x1870705582941696:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 208us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044057.111655:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:3.0:1784044057.123138:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044057.123719:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582941824 00000100:00100000:2.0:1784044057.123757:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582941824 00000100:00100000:2.0:1784044057.123834:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 212 00000100:00100000:2.0:1784044057.124040:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+12:8097:x1870705582941824:12345-192.168.204.50@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784044057.124074:0:5762:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784044057.124095:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784044057.124099:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784044057.124103:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784044057.124106:0:5762:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1784044057.139193:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+12:8097:x1870705582941824:12345-192.168.204.50@tcp:256:mount.lustre.0 Request processed in 15138us (16051us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044057.139216:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 212 00000100:00100000:2.0:1784044057.147819:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044057.147903:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582941952 00000100:00100000:1.0:1784044057.147913:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582941952 00000100:00100000:1.0:1784044057.148091:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:1.0:1784044057.148103:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+12:8097:x1870705582941952:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784044057.148120:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044057.148140:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1663200/0x9cc73983a75500f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead5d7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044057.148192:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1663200/0x9cc73983a75500f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d7 expref: 13 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044057.148203:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1663200/0x9cc73983a75500f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d7 expref: 13 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044057.148213:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663200, rc 0) 00000100:00100000:1.0:1784044057.148295:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:8097:x1870705582941952:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 194us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.148303:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:3.0:1784044057.154410:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044057.154498:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582942080 00000100:00100000:2.0:1784044057.154510:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582942080 00000100:00100000:2.0:1784044057.154559:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:2.0:1784044057.154577:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:8097:x1870705582942080:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784044057.155110:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:8097:x1870705582942080:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 539us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044057.155120:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:3.0:1784044057.161543:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044057.161730:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582942208 00000100:00100000:1.0:1784044057.161741:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582942208 00000100:00100000:1.0:1784044057.161920:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00100000:1.0:1784044057.161930:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:8097:x1870705582942208:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784044057.162160:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:8097:x1870705582942208:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 230us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.162168:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00100000:2.0:1784044057.174294:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044057.174361:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582942336 00000100:00100000:0.0:1784044057.174370:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582942336 00000100:00100000:0.0:1784044057.174418:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:0.0:1784044057.174427:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:8105:x1870705582942336:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044057.174702:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:8105:x1870705582942336:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 274us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044057.174710:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:3.0:1784044057.178826:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044057.181090:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582942464 00000100:00100000:1.0:1784044057.181105:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582942464 00000100:00100000:1.0:1784044057.181175:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 217 00000100:00100000:1.0:1784044057.181186:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:8105:x1870705582942464:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044057.183154:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:8105:x1870705582942464:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 1958us (4325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.183170:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 217 00000100:00100000:3.0:1784044057.204604:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044057.204772:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582942592 00000100:00100000:1.0:1784044057.204798:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582942592 00000100:00100000:1.0:1784044057.204851:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1784044057.204860:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2344:x1870705582942592:12345-192.168.204.50@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784044057.204931:0:5770:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from c96f0df8-2a11-4448-8c45-0205cd1a93d6@192.168.204.50@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:1.0:1784044057.204982:0:5770:0:(genops.c:1406:class_connect()) connect: client c96f0df8-2a11-4448-8c45-0205cd1a93d6, cookie 0x9cc73983a75500f9 00000004:00100000:1.0:1784044057.205017:0:5770:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784044057.205304:0:5770:0:(import.c:65:import_set_state_nolock()) ffff904bfb414800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044057.205377:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:2344:x1870705582942592:12345-192.168.204.50@tcp:38:mount.lustre.0 Request processed in 517us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.205385:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1784044057.207761:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044057.207896:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582942720 00000100:00100000:1.0:1784044057.207906:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582942720 00000100:00100000:1.0:1784044057.207994:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:1.0:1784044057.208005:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582942720:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044057.208073:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582942720:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 70us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.208082:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00080000:2.0:1784044057.208210:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044057.224574:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044057.224615:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044057.224708:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582942848 00000100:00100000:1.0:1784044057.224719:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582942848 00000100:00100000:1.0:1784044057.224806:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582942976 00000100:00100000:1.0:1784044057.224809:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582942976 00000100:00100000:1.0:1784044057.224835:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044057.224845:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+7:0:x1870705582942848:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784044057.224921:0:5770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784044057.225003:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+7:0:x1870705582942848:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 158us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.225027:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044057.225048:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1784044057.225056:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:8097:x1870705582942976:12345-192.168.204.50@tcp:41:mount.lustre.0 00000100:00080000:2.0:1784044057.225058:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1784044057.225068:0:5770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784044057.225094:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:8097:x1870705582942976:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.225101:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:0.0:1784044057.233397:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044057.233493:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582943104 00000100:00100000:2.0:1784044057.233504:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582943104 00000100:00100000:2.0:1784044057.233566:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:2.0:1784044057.233575:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:8097:x1870705582943104:12345-192.168.204.50@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784044057.233654:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:8097:x1870705582943104:12345-192.168.204.50@tcp:40:mount.lustre.0 Request processed in 81us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044057.233675:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:2.0:1784044057.238401:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044057.238441:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044057.238479:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044057.238583:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582943232 00000100:00100000:0.0:1784044057.238593:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582943232 00000100:00100000:0.0:1784044057.238633:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582943360 00000100:00100000:0.0:1784044057.238636:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582943360 00000100:00100000:0.0:1784044057.238653:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:0.0:1784044057.238662:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1870705582943232:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784044057.238704:0:6571:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c96f0df8-2a11-4448-8c45-0205cd1a93d6@192.168.204.50@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:0.0:1784044057.238739:0:6571:0:(genops.c:1406:class_connect()) connect: client c96f0df8-2a11-4448-8c45-0205cd1a93d6, cookie 0x9cc73983a7550100 00000100:00100000:3.0:1784044057.238750:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582943488 00002000:00100000:0.0:1784044057.238752:0:6571:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c96f0df8-2a11-4448-8c45-0205cd1a93d6/ffff904bc7f7a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1784044057.238757:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582943488 00002000:00100000:0.0:1784044057.238766:0:6571:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1784044057.238800:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1784044057.238809:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:8097:x1870705582943488:12345-192.168.204.50@tcp:33:mount.lustre.0 00002000:00080000:0.0:1784044057.239079:0:6571:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784044057.239109:0:6571:0:(import.c:65:import_set_state_nolock()) ffff904bc7f78800 : changing import state from RECOVER to FULL 00000004:00200000:3.0:1784044057.239146:0:5772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1784044057.239172:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:2344:x1870705582943232:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 508us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044057.239181:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:3.0:1784044057.239268:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:8097:x1870705582943488:12345-192.168.204.50@tcp:33:mount.lustre.0 Request processed in 459us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044057.239276:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:2.0:1784044057.242728:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:2.0:1784044057.242745:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1870705582943360:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784044057.242923:0:8310:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from c96f0df8-2a11-4448-8c45-0205cd1a93d6@192.168.204.50@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:3.0:1784044057.242974:0:8310:0:(genops.c:1406:class_connect()) connect: client c96f0df8-2a11-4448-8c45-0205cd1a93d6, cookie 0x9cc73983a7550107 00002000:00100000:3.0:1784044057.242989:0:8310:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c96f0df8-2a11-4448-8c45-0205cd1a93d6/ffff904bff99c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784044057.242999:0:8310:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784044057.243246:0:8310:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784044057.243295:0:8310:0:(import.c:65:import_set_state_nolock()) ffff904bff99b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044057.243368:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:2344:x1870705582943360:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 625us (4886us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044057.243378:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00010000:00010000:2.0:1784044057.439676:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784044057.585534:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c96f0df8-2a11-4448-8c45-0205cd1a93d6 00010000:00010000:1.0:1784044058.462106:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784044058.606114:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c96f0df8-2a11-4448-8c45-0205cd1a93d6 00010000:00010000:2.0:1784044059.486383:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784044059.616284:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c96f0df8-2a11-4448-8c45-0205cd1a93d6 00010000:00010000:1.0:1784044060.511191:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044061.534208:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044061.598360:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598702848:0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.598434:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044061.598488:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598703360:0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.598518:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044061.598543:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784044061.598548:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598702976:0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.598568:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044061.598582:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598703488:0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.598613:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044061.598652:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598703232:0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.598682:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044061.598704:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044061.598709:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598703104:0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.598731:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044061.598778:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598703488 00000100:00100000:1.0:1784044061.598786:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598703488 00000100:00100000:1.0:1784044061.598840:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598703232 00000100:00100000:1.0:1784044061.598844:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598703232 00000100:00100000:1.0:1784044061.598895:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044061.598904:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598703488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.598957:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598703488:12345-0@lo:400:kworker.0 Request processed in 54us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044061.598964:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044061.598981:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044061.598987:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598703232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.599016:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598703232:12345-0@lo:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044061.599022:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044061.599036:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598703360 00000100:00100000:1.0:1784044061.599039:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598703360 00000100:00100000:1.0:1784044061.599061:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598702976 00000100:00100000:1.0:1784044061.599063:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598702976 00000100:00100000:1.0:1784044061.599071:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598703104 00000100:00100000:1.0:1784044061.599073:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598703104 00000100:00100000:1.0:1784044061.599084:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784044061.599089:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598703360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.599113:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598703360:12345-0@lo:400:kworker.0 Request processed in 24us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044061.599118:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784044061.599127:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784044061.599132:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598702976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.599150:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598702976:12345-0@lo:400:kworker.0 Request processed in 19us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044061.599161:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784044061.599171:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784044061.599175:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598703104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.599197:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598703104:12345-0@lo:400:kworker.0 Request processed in 22us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044061.599202:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1784044061.599215:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044061.599219:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784044061.599220:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044061.599252:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598703104:0@lo:400:kworker.0 00010000:00080000:1.0:1784044061.599266:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff598380 x1870705598703232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044061.599275:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598703232:0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.599302:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598702976:0@lo:400:kworker.0 00010000:00080000:1.0:1784044061.599311:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff599880 x1870705598703488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044061.599319:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598703488:0@lo:400:kworker.0 00000100:00100000:1.0:1784044061.599328:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598703360:0@lo:400:kworker.0 00000100:00100000:0.0:1784044061.599541:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598702848 00000100:00100000:0.0:1784044061.599546:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598702848 00000100:00100000:0.0:1784044061.599580:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784044061.599586:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598702848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044061.599638:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598702848:12345-0@lo:400:kworker.0 Request processed in 51us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044061.599643:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784044061.599995:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598702848:0@lo:400:kworker.0 00000100:00100000:3.0:1784044061.600283:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598703616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044061.600316:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044061.600378:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598703616 00000100:00100000:2.0:1784044061.600383:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598703616 00000100:00100000:2.0:1784044061.600415:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784044061.600422:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598703616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044061.600450:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044061.603226:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598703616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2796us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044061.603241:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1784044061.606982:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff599f80 x1870705598703616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044061.607012:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598703616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044062.112017:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598703744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044062.112097:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044062.112223:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598703744 00000100:00100000:3.0:1784044062.112231:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598703744 00000100:00100000:2.0:1784044062.114522:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784044062.114554:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598703744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044062.114614:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044062.114784:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598703744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 249us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.114808:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1784044062.115119:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffca9f80 x1870705598703744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044062.115144:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598703744:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784044062.558127:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044062.597511:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044062.597594:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044062.597628:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044062.597654:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044062.597678:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044062.597707:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582944128 00000100:00100000:2.0:1784044062.597716:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582944128 00000100:00100000:2.0:1784044062.597773:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582944000 00000100:00100000:2.0:1784044062.597776:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582944000 00000100:00100000:2.0:1784044062.597799:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:2.0:1784044062.597809:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2345:x1870705582944128:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044062.597898:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2345:x1870705582944128:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.597906:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:2.0:1784044062.597922:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:2.0:1784044062.597928:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2345:x1870705582944000:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044062.597952:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2345:x1870705582944000:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 24us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.597957:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:2.0:1784044062.597976:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582943872 00000100:00100000:2.0:1784044062.597979:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582943872 00000100:00100000:2.0:1784044062.598001:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582943744 00000100:00100000:2.0:1784044062.598004:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582943744 00000100:00100000:2.0:1784044062.598040:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:2.0:1784044062.598047:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2345:x1870705582943872:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044062.598083:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2345:x1870705582943872:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.598089:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:2.0:1784044062.598102:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:2.0:1784044062.598109:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582943744:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044062.598131:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582943744:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 23us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.598136:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00080000:2.0:1784044062.598154:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044062.598158:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044062.598160:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044062.598235:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582943616 00000100:00100000:3.0:1784044062.598240:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582943616 00000100:00100000:3.0:1784044062.598273:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 219 00000100:00100000:3.0:1784044062.598280:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582943616:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044062.598308:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582943616:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 29us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044062.598313:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 219 00000001:02000400:0.0:1784044063.074474:0:10155:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1784044063.583954:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044064.609224:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044065.630050:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044066.654494:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044066.721819:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044066.721845:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598703872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044066.721940:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044066.722019:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598703872 00000100:00100000:0.0:1784044066.722027:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598703872 00000100:00100000:0.0:1784044066.722090:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784044066.722100:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598703872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044066.722138:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044066.722186:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598703872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044066.722193:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1784044066.722219:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784044066.722251:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff599500 x1870705598703872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044066.722272:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598703872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044066.722462:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598704256:0@lo:400:kworker.0 00000100:00100000:2.0:1784044066.722496:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044066.722529:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044066.722535:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598704128:0@lo:400:kworker.0 00000100:00100000:2.0:1784044066.722557:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044066.722582:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598704256 00000100:00100000:2.0:1784044066.722587:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598704256 00000100:00100000:2.0:1784044066.722619:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598704128 00000100:00100000:2.0:1784044066.722622:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598704128 00000100:00100000:2.0:1784044066.722643:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784044066.722650:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598704256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044066.722687:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598704256:12345-0@lo:400:kworker.0 Request processed in 37us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044066.722702:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784044066.722717:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784044066.722723:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598704128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044066.722753:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598704128:12345-0@lo:400:kworker.0 Request processed in 31us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044066.722759:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784044066.722794:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598704128:0@lo:400:kworker.0 00000100:00100000:2.0:1784044066.722803:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598704256:0@lo:400:kworker.0 00000100:00100000:0.0:1784044066.723177:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598704384:0@lo:400:kworker.0 00000100:00100000:0.0:1784044066.723205:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044066.723227:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784044066.723239:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598704000:0@lo:400:kworker.0 00000100:00100000:0.0:1784044066.723263:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044066.723280:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598704512:0@lo:400:kworker.0 00000100:00100000:0.0:1784044066.723297:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044066.723321:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598704512 00000100:00100000:0.0:1784044066.723325:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598704512 00000100:00100000:0.0:1784044066.723354:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784044066.723360:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598704512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044066.723391:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598704512:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044066.723397:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1784044066.723419:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044066.723422:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784044066.723438:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb438e00 x1870705598704512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044066.723449:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598704512:0@lo:400:kworker.0 00000100:00100000:2.0:1784044066.723493:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598704384 00000100:00100000:2.0:1784044066.723497:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598704384 00000100:00100000:2.0:1784044066.723547:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784044066.723553:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598704384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044066.723586:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598704384:12345-0@lo:400:kworker.0 Request processed in 33us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044066.723591:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044066.723645:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598704000 00000100:00100000:3.0:1784044066.723649:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598704000 00000100:00100000:3.0:1784044066.723683:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1784044066.723689:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598704000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044066.723724:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598704000:12345-0@lo:400:kworker.0 Request processed in 35us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044066.723730:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1784044066.724053:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044066.724073:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598704000:0@lo:400:kworker.0 00000100:00100000:0.0:1784044066.724084:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598704384:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.233600:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044067.233626:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598704640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044067.233694:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044067.235219:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598704640 00000100:00100000:0.0:1784044067.235231:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598704640 00000100:00100000:0.0:1784044067.235654:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784044067.235665:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598704640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044067.235700:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044067.236085:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598704640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 420us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044067.236111:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1784044067.236310:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffca9500 x1870705598704640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044067.236333:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598704640:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784044067.695018:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044067.710178:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044067.710222:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044067.710259:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044067.710283:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044067.710310:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044067.710337:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582944768 00000100:00100000:3.0:1784044067.710346:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582944768 00000100:00100000:3.0:1784044067.710414:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582944640 00000100:00100000:3.0:1784044067.710417:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582944640 00000100:00100000:3.0:1784044067.710444:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:3.0:1784044067.710454:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705582944768:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044067.710538:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705582944768:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.710545:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:3.0:1784044067.710562:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:3.0:1784044067.710569:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705582944640:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044067.710595:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705582944640:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.710601:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:3.0:1784044067.710620:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582944512 00000100:00100000:3.0:1784044067.710623:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582944512 00000100:00100000:3.0:1784044067.710649:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582944384 00000100:00100000:3.0:1784044067.710652:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582944384 00000100:00100000:3.0:1784044067.710673:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:3.0:1784044067.710679:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705582944512:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044067.710712:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705582944512:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 32us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.710719:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:3.0:1784044067.710731:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:3.0:1784044067.710737:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582944384:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044067.710760:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582944384:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 24us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.710776:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00080000:3.0:1784044067.710796:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044067.710801:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044067.710803:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044067.711112:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582944256 00000100:00100000:2.0:1784044067.711117:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582944256 00000100:00100000:2.0:1784044067.711143:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 221 00000100:00100000:2.0:1784044067.711150:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582944256:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044067.711181:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582944256:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 32us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044067.711196:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 221 00010000:00010000:1.0:1784044068.702130:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044069.726228:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044070.752203:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044071.774443:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044071.838346:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598704768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044071.838439:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044071.839496:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598704768 00000100:00100000:3.0:1784044071.839507:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598704768 00000100:00080000:2.0:1784044071.839902:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044071.851059:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784044071.851127:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598705152:0@lo:400:kworker.0 00000100:00100000:2.0:1784044071.851218:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044071.851219:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598704896:0@lo:400:kworker.0 00000100:00100000:0.0:1784044071.851269:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044071.851312:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044071.851322:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598705024:0@lo:400:kworker.0 00000100:00100000:2.0:1784044071.851341:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598705280:0@lo:400:kworker.0 00000100:00100000:0.0:1784044071.851350:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044071.851379:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044071.851396:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598704896 00000100:00100000:0.0:1784044071.851403:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598704896 00000100:00100000:3.0:1784044071.851414:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598704768:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044071.851464:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784044071.851474:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598704896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044071.851515:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598704896:12345-0@lo:400:kworker.0 Request processed in 44us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044071.851522:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784044071.851554:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044071.851562:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598705408:0@lo:400:kworker.0 00000100:00100000:0.0:1784044071.851588:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044071.852111:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598704896:0@lo:400:kworker.0 00000100:00100000:2.0:1784044071.852171:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598705408 00000100:00100000:0.0:1784044071.852171:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598705152 00000100:00100000:2.0:1784044071.852178:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598705408 00000100:00100000:0.0:1784044071.852178:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598705152 00000100:00100000:0.0:1784044071.852223:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598705024 00000100:00100000:0.0:1784044071.852227:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598705024 00000100:00100000:0.0:1784044071.852237:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598705280 00000100:00100000:0.0:1784044071.852240:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598705280 00000100:00100000:0.0:1784044071.852258:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784044071.852265:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598705152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044071.852312:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598705152:12345-0@lo:400:kworker.0 Request processed in 47us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044071.852332:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784044071.852345:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784044071.852351:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598705024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044071.852382:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598705024:12345-0@lo:400:kworker.0 Request processed in 31us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044071.852387:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784044071.852397:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784044071.852402:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598705280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044071.852432:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784044071.852449:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598705280:12345-0@lo:400:kworker.0 Request processed in 46us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044071.852455:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1784044071.852556:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044071.852562:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044071.852587:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598705152:0@lo:400:kworker.0 00000100:00100000:0.0:1784044071.852611:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598705024:0@lo:400:kworker.0 00000100:00100000:2.0:1784044071.852637:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598705408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044071.852679:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598705408:12345-0@lo:400:kworker.0 Request processed in 47us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044071.852687:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00002000:00000024:3.0:1784044071.853266:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044071.853334:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598704768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2261us (14893us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044071.853343:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784044071.854560:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598705280:0@lo:400:kworker.0 00010000:00080000:0.0:1784044071.854580:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb439500 x1870705598704768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044071.855818:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598704768:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1784044071.855924:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb438700 x1870705598705408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044071.855935:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598705408:0@lo:400:kworker.0 00000100:00100000:0.0:1784044072.350385:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598705536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044072.350568:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044072.350897:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598705536 00000100:00100000:2.0:1784044072.350909:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598705536 00000100:00100000:2.0:1784044072.350977:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044072.350989:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598705536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044072.351039:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044072.351103:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598705536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044072.351112:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1784044072.351412:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb438700 x1870705598705536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044072.351436:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598705536:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784044072.817184:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044072.832221:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044072.832277:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044072.832307:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044072.832332:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044072.832359:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044072.832408:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582945408 00000100:00100000:3.0:1784044072.832421:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582945408 00000100:00100000:3.0:1784044072.832496:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582945280 00000100:00100000:3.0:1784044072.832500:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582945280 00000100:00100000:3.0:1784044072.832528:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:3.0:1784044072.832541:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582945408:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044072.832642:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582945408:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 103us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044072.832650:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:3.0:1784044072.832684:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:3.0:1784044072.832691:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582945280:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044072.832720:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582945280:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044072.832727:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:0.0:1784044072.834050:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582945152 00000100:00100000:0.0:1784044072.834064:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582945152 00000100:00100000:0.0:1784044072.834128:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582945024 00000100:00100000:0.0:1784044072.834132:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582945024 00000100:00100000:0.0:1784044072.834168:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:0.0:1784044072.834177:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582945152:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044072.834256:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582945152:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 79us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044072.834264:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:0.0:1784044072.834280:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:0.0:1784044072.834287:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705582945024:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044072.834310:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705582945024:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 25us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044072.834316:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00080000:0.0:1784044072.834339:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044072.834344:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044072.834347:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044072.835037:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582944896 00000100:00100000:1.0:1784044072.835047:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582944896 00000100:00100000:1.0:1784044072.835105:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 223 00000100:00100000:1.0:1784044072.835115:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705582944896:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044072.835170:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705582944896:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 57us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044072.835178:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 223 00010000:00010000:2.0:1784044073.822439:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044074.851319:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044075.876898:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044076.894412:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044076.959099:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044076.959129:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598705664:0@lo:400:kworker.0 00000100:00100000:0.0:1784044076.959208:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044076.959274:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598705792:0@lo:400:kworker.0 00000100:00100000:3.0:1784044076.959306:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598706176:0@lo:400:kworker.0 00000100:00100000:0.0:1784044076.959350:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044076.959391:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598706304:0@lo:400:kworker.0 00000100:00100000:3.0:1784044076.959393:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044076.959452:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598706048:0@lo:400:kworker.0 00000100:00100000:1.0:1784044076.960845:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598705920:0@lo:400:kworker.0 00000100:00100000:2.0:1784044076.961291:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598705792 00000100:00100000:2.0:1784044076.961303:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598705792 00000100:00100000:2.0:1784044076.961379:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598706176 00000100:00100000:2.0:1784044076.961385:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598706176 00000100:00100000:2.0:1784044076.961428:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784044076.961438:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044076.961448:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598705792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044076.961811:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044076.961961:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784044076.961973:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598706176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044076.962541:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598706176:12345-0@lo:400:kworker.0 Request processed in 50us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044076.962555:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784044076.962664:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598706304 00000100:00100000:3.0:1784044076.962672:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598706304 00000100:00100000:3.0:1784044076.962714:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598706048 00000100:00100000:3.0:1784044076.962718:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598706048 00000100:00100000:3.0:1784044076.962742:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784044076.962749:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598706304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044076.962801:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598706304:12345-0@lo:400:kworker.0 Request processed in 52us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044076.962808:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784044076.962822:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784044076.962949:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598706048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044076.963000:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044076.963014:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598706048:12345-0@lo:400:kworker.0 Request processed in 68us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044076.963046:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598706432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044076.963083:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044076.963546:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784044076.963656:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598705920 00000100:00100000:3.0:1784044076.963662:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598705920 00000100:00100000:3.0:1784044076.963695:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784044076.963702:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598705920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044076.963759:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598705920:12345-0@lo:400:kworker.0 Request processed in 58us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044076.963766:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784044076.963809:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598705920:0@lo:400:kworker.0 00000100:00100000:2.0:1784044076.963964:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598705792:12345-0@lo:400:kworker.0 Request processed in 2524us (4612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044076.963973:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1784044076.963999:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044076.964004:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044076.964007:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044076.964017:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598706432 00000100:00100000:2.0:1784044076.964021:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598706432 00000100:00100000:3.0:1784044076.964664:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598706176:0@lo:400:kworker.0 00010000:00080000:3.0:1784044076.964711:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bffcaa680 x1870705598706048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044076.964723:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598706048:0@lo:400:kworker.0 00000100:00100000:2.0:1784044076.964819:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044076.964925:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598706432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044076.964972:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044076.965102:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598706432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 274us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044076.965110:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1784044076.965249:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb439500 x1870705598706432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044076.965268:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598706432:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1784044076.965602:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff430a80 x1870705598706304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044076.965621:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598706304:0@lo:400:kworker.0 00000100:00100000:0.0:1784044076.965637:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598705792:0@lo:400:kworker.0 00000100:00100000:0.0:1784044076.965693:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598705664 00000100:00100000:0.0:1784044076.965700:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598705664 00000100:00100000:0.0:1784044076.965760:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1784044076.965770:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598705664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044076.966198:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598705664:12345-0@lo:400:kworker.0 Request processed in 428us (6990us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044076.966207:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1784044076.970198:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598705664:0@lo:400:kworker.0 00000100:00100000:3.0:1784044077.473248:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598706560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044077.473332:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044077.473422:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598706560 00000100:00100000:1.0:1784044077.473431:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598706560 00000100:00100000:1.0:1784044077.473482:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784044077.473491:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598706560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044077.473526:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044077.477790:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598706560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4291us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044077.477803:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1784044077.477910:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb43a680 x1870705598706560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044077.477936:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598706560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784044077.918364:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044077.954756:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044077.954810:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044077.954861:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044077.954923:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044077.954950:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044077.955169:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582945664 00000100:00100000:1.0:1784044077.955179:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582945664 00000100:00100000:1.0:1784044077.955247:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582945792 00000100:00100000:1.0:1784044077.955251:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582945792 00000100:00100000:1.0:1784044077.955275:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:1.0:1784044077.955285:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582945664:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044077.955371:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582945664:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 87us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044077.955379:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:1.0:1784044077.955395:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:1.0:1784044077.955402:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705582945792:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044077.955425:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705582945792:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 23us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044077.955431:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:2.0:1784044077.955508:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582945536 00000100:00100000:2.0:1784044077.955512:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582945536 00000100:00100000:3.0:1784044077.955559:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582945920 00000100:00100000:3.0:1784044077.955563:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582945920 00000100:00080000:0.0:1784044077.955757:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044077.955762:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044077.958159:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 225 00000100:00100000:2.0:1784044077.958179:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582945536:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044077.958280:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582945536:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 109us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044077.958288:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 225 00000100:00100000:3.0:1784044077.961483:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582946048 00000100:00100000:3.0:1784044077.961502:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582946048 00000100:00080000:2.0:1784044077.961994:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044077.962410:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1784044077.962431:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2344:x1870705582945920:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:1.0:1784044077.962470:0:6571:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a7550100 00000100:00080000:1.0:1784044077.962480:0:6571:0:(import.c:65:import_set_state_nolock()) ffff904bc7f78800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784044077.962777:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:0.0:1784044077.962788:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2344:x1870705582946048:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:0.0:1784044077.962803:0:6569:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a7550107 00000100:00080000:0.0:1784044077.962809:0:6569:0:(import.c:65:import_set_state_nolock()) ffff904bff99b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784044077.962883:0:6571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1784044077.963222:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+2:2344:x1870705582945920:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 800us (8296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044077.963232:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00010000:00010000:2.0:1784044077.963725:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784044077.964166:0:6569:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1784044077.964549:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+2:2344:x1870705582946048:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 1759us (9593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044077.964560:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00010000:00010000:2.0:1784044077.964605:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784044078.043481:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c96f0df8-2a11-4448-8c45-0205cd1a93d6 00000020:00000080:2.0:1784044078.043491:0:6598:0:(genops.c:906:class_export_put()) final put ffff904bc7f7a800/c96f0df8-2a11-4448-8c45-0205cd1a93d6 00000020:00000080:0.0:1784044078.043579:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc7f7a800/c96f0df8-2a11-4448-8c45-0205cd1a93d6 for lustre-OST0000 00000020:00000080:0.0:1784044078.043771:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bc7f78800 for lustre-OST0000 00000001:02000400:2.0:1784044078.857129:0:10858:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1784044078.943086:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784044079.075316:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c96f0df8-2a11-4448-8c45-0205cd1a93d6 00000020:00000080:2.0:1784044079.075325:0:7484:0:(genops.c:906:class_export_put()) final put ffff904bff99c800/c96f0df8-2a11-4448-8c45-0205cd1a93d6 00000020:00000080:1.0:1784044079.075411:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff99c800/c96f0df8-2a11-4448-8c45-0205cd1a93d6 for lustre-OST0001 00000020:00000080:1.0:1784044079.075530:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bff99b800 for lustre-OST0001 00010000:00010000:2.0:1784044079.966045:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044080.993451:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044082.014105:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044082.080631:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044082.080655:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598706688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044082.080725:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044082.081047:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598707072:0@lo:400:kworker.0 00000100:00100000:3.0:1784044082.081115:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044082.081148:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044082.081154:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598706944:0@lo:400:kworker.0 00000100:00100000:3.0:1784044082.081178:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044082.081202:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598707200:0@lo:400:kworker.0 00000100:00100000:3.0:1784044082.081251:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044082.081267:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784044082.081284:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598706816:0@lo:400:kworker.0 00000100:00100000:3.0:1784044082.081311:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044082.081333:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598707328:0@lo:400:kworker.0 00000100:00100000:3.0:1784044082.081355:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044082.081503:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598706688 00000100:00100000:2.0:1784044082.081512:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598706688 00000100:00100000:2.0:1784044082.081577:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784044082.081587:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598706688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044082.081623:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044082.081665:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598706688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044082.081672:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784044082.081756:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598707328 00000100:00100000:1.0:1784044082.081761:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598707328 00000100:00100000:1.0:1784044082.081803:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044082.081812:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598707328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044082.081850:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598707328:12345-0@lo:400:kworker.0 Request processed in 41us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044082.081857:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1784044082.081924:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb43b480 x1870705598706688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044082.081945:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598706688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044082.082027:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598707072 00000100:00100000:0.0:1784044082.082032:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598707072 00000100:00100000:0.0:1784044082.082073:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598706944 00000100:00100000:0.0:1784044082.082077:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598706944 00000100:00100000:0.0:1784044082.082089:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598707200 00000100:00100000:0.0:1784044082.082092:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598707200 00000100:00100000:0.0:1784044082.082106:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784044082.082112:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598707072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044082.082155:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598707072:12345-0@lo:400:kworker.0 Request processed in 42us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044082.082161:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784044082.082175:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784044082.082181:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598706944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044082.082225:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598706944:12345-0@lo:400:kworker.0 Request processed in 30us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044082.082232:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784044082.082245:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784044082.082251:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598707200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044082.082364:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598707200:12345-0@lo:400:kworker.0 Request processed in 113us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044082.082370:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784044082.082396:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598706816 00000100:00100000:0.0:1784044082.082400:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598706816 00000100:00100000:0.0:1784044082.082421:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784044082.082426:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598706816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044082.082455:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598706816:12345-0@lo:400:kworker.0 Request processed in 28us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044082.082473:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784044082.082514:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598706944:0@lo:400:kworker.0 00000100:00100000:0.0:1784044082.082525:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598707072:0@lo:400:kworker.0 00000100:00080000:3.0:1784044082.084171:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044082.084183:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044082.084187:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044082.084244:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598706816:0@lo:400:kworker.0 00010000:00080000:3.0:1784044082.084266:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5c4d880 x1870705598707328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044082.084312:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598707328:0@lo:400:kworker.0 00000100:00100000:3.0:1784044082.084329:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598707200:0@lo:400:kworker.0 00000100:00100000:0.0:1784044082.595158:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598707456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044082.595258:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044082.595357:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598707456 00000100:00100000:1.0:1784044082.595365:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598707456 00000100:00100000:1.0:1784044082.595418:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784044082.595428:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598707456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044082.595462:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044082.621909:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598707456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 26471us (26639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044082.621925:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1784044082.621930:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff431180 x1870705598707456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044082.621959:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598707456:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1784044082.969320:0:11007:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb353f570 20000000:00000080:2.0:1784044082.969339:0:11007:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff904bfb311c00 uarg=0000000000000000 20000000:01000000:2.0:1784044082.969380:0:11007:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784044082.969386:0:11007:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784044082.969390:0:11007:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784044082.971397:0:11008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1784044082.971731:0:11007:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784044082.984010:0:11007:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784044082.984056:0:11007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.984084:0:11007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904c02177e00/0x9cc73983a75500ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75500b3 expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.984094:0:11007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1662200/0x9cc73983a75500c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75500c1 expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.984101:0:11007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1663600/0x9cc73983a75500d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75500cf expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.984112:0:11007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bffa9ba00/0x9cc73983a75500dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead59f expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.984121:0:11007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1663200/0x9cc73983a75500f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d7 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.984129:0:11007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044082.984537:0:11007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1663200/0x9cc73983a75500f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d7 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044082.984560:0:11007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904bc1663200/0x9cc73983a75500f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d7 expref: 12 pid: 5763 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044082.984580:0:11007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11007:1870705598707584:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044082.984804:0:11007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bffa9ba00/0x9cc73983a75500dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead59f expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044082.984814:0:11007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904bffa9ba00/0x9cc73983a75500dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead59f expref: 12 pid: 5762 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044082.984822:0:11007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff432a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11007:1870705598707712:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044082.984859:0:11007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1663600/0x9cc73983a75500d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a75500cf expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044082.985106:0:11007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1663600/0x9cc73983a75500d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a75500cf expref: 18 pid: 5763 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044082.985118:0:11007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff431c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11007:1870705598707840:0@lo:104: 00000100:00100000:3.0:1784044082.985177:0:11007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044082.985239:0:11007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1662200/0x9cc73983a75500c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a75500c1 expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044082.985277:0:11007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc1662200/0x9cc73983a75500c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a75500c1 expref: 18 pid: 5764 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044082.985286:0:11007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff433480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11007:1870705598707968:0@lo:104: 00000100:00100000:3.0:1784044082.985311:0:11007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044082.985351:0:11007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904c02177e00/0x9cc73983a75500ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a75500b3 expref: 18 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044082.985369:0:11007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904c02177e00/0x9cc73983a75500ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a75500b3 expref: 18 pid: 5764 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044082.985378:0:11007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff430a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11007:1870705598708096:0@lo:104: 00000100:00100000:3.0:1784044082.985402:0:11007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044082.985439:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598707840 00000100:00100000:3.0:1784044082.985447:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598707840 00000100:00100000:3.0:1784044082.985511:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598707968 00000100:00100000:3.0:1784044082.985514:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598707968 00000100:00100000:3.0:1784044082.985527:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598708096 00000100:00100000:3.0:1784044082.985530:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598708096 00000100:00100000:3.0:1784044082.985546:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784044082.985556:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+5:11007:x1870705598707840:12345-0@lo:104: 00010000:00010000:3.0:1784044082.985573:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044082.985627:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044082.985634:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+5:11007:x1870705598707840:12345-0@lo:104: Request processed in 80us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044082.985641:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784044082.985668:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044082.985674:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:11007:x1870705598707968:12345-0@lo:104: 00010000:00010000:3.0:1784044082.985682:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044082.985943:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044082.985954:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:11007:x1870705598708096:12345-0@lo:104: 00010000:00010000:2.0:1784044082.985963:0:5754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986566:0:5754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784044082.986576:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:11007:x1870705598708096:12345-0@lo:104: Request processed in 624us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044082.986594:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1784044082.986619:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044082.986626:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986635:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904c02177400 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044082.986640:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986650:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044082.986659:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044082.986666:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044082.986719:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986726:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044082.986761:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986769:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904c02177400/0x9cc73983a75500cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75500d6 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986783:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044082.986786:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986803:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ac00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044082.986807:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986813:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044082.986819:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044082.986824:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044082.986840:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986846:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044082.986888:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986896:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75500b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75500ba expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.986906:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044082.986909:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044082.986911:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044082.986918:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044082.986945:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598708224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044082.987001:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044082.987057:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598708352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044082.987092:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044082.987130:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598708224 00000100:00100000:2.0:1784044082.987138:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598708224 00010000:00010000:2.0:1784044082.987169:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1663600/0x9cc73983a75500d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75500cf expref: 19 pid: 5763 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044082.987206:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598708352 00000100:00100000:2.0:1784044082.987209:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598708352 00010000:00010000:2.0:1784044082.987221:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904c02177e00/0x9cc73983a75500ba lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75500b3 expref: 20 pid: 5764 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044082.987241:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784044082.987250:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3289:x1870705598708224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044082.988019:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044082.988032:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1663600/0x9cc73983a75500d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75500cf expref: 20 pid: 5763 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.988045:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1663600/0x9cc73983a75500d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a75500cf expref: 20 pid: 5763 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.988070:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044082.988133:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3289:x1870705598708224:12345-0@lo:103:ldlm_bl.0 Request processed in 882us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044082.988142:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784044082.988219:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784044082.988230:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb439180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598708352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044082.988238:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044082.988243:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904c02177e00/0x9cc73983a75500ba lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75500b3 expref: 19 pid: 5764 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.988336:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904c02177e00/0x9cc73983a75500ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a75500b3 expref: 19 pid: 5764 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.988347:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044082.988983:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb439180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598708352:12345-0@lo:103:ldlm_bl.0 Request processed in 753us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044082.988993:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784044082.989074:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598708352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044082.989114:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598708224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044082.989237:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044082.989247:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:11007:x1870705598707968:12345-0@lo:104: Request processed in 3571us (3933us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044082.989265:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044082.989309:0:11007:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50339c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784044082.989329:0:11007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1663600/0x9cc73983a75500d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a75500cf expref: 18 pid: 5763 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044082.989347:0:11007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff431c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11007:1870705598707840:0@lo:104: 00000100:00100000:3.0:1784044082.989494:0:11007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff433480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11007:1870705598707968:0@lo:104: 00010000:00010000:3.0:1784044082.989506:0:11007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904c02177e00/0x9cc73983a75500ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a75500b3 expref: 17 pid: 5764 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044082.989519:0:11007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff430a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11007:1870705598708096:0@lo:104: 00010000:00010000:2.0:1784044082.989717:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044082.989726:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.989787:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662e00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044082.989792:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.989802:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044082.989809:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044082.989815:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044082.989897:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.989904:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044082.989941:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.989949:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1662e00/0x9cc73983a75500c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75500c8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.989967:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044082.989970:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044082.989972:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044082.989979:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044082.989993:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598708480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044082.990052:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044082.990089:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598708480 00000100:00100000:2.0:1784044082.990097:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598708480 00010000:00010000:2.0:1784044082.990130:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1662200/0x9cc73983a75500c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75500c1 expref: 17 pid: 5764 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044082.990159:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784044082.990168:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:3290:x1870705598708480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044082.990180:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044082.990185:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1662200/0x9cc73983a75500c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75500c1 expref: 17 pid: 5764 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.990209:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1662200/0x9cc73983a75500c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a75500c1 expref: 17 pid: 5764 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.990224:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1662200/0x9cc73983a75500c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a75500c1 expref: 17 pid: 5764 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.990238:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044082.990527:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:3290:x1870705598708480:12345-0@lo:103:ldlm_bl.0 Request processed in 358us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044082.990535:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044082.990603:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598708480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044082.996958:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044082.997070:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044082.999397:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582946176 00000100:00100000:2.0:1784044082.999418:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582946176 00010000:00010000:2.0:1784044082.999491:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1663200/0x9cc73983a75500f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d7 expref: 13 pid: 5763 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044082.999541:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582946304 00000100:00100000:2.0:1784044082.999545:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582946304 00010000:00010000:2.0:1784044082.999560:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bffa9ba00/0x9cc73983a75500dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead59f expref: 14 pid: 5762 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044082.999589:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:2.0:1784044082.999601:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f40c65c2-a2d0-42d6-a031-2092177c578a+14:2347:x1870705582946176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044082.999623:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044082.999631:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1663200/0x9cc73983a75500f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d7 expref: 14 pid: 5763 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999645:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1663200/0x9cc73983a75500f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d7 expref: 14 pid: 5763 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999674:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044082.999759:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f40c65c2-a2d0-42d6-a031-2092177c578a+14:2347:x1870705582946176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 160us (2822us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044082.999768:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:2.0:1784044082.999790:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:2.0:1784044082.999797:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582946304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044082.999805:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044082.999826:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bffa9ba00/0x9cc73983a75500dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead59f expref: 13 pid: 5762 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999837:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bffa9ba00/0x9cc73983a75500dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead59f expref: 13 pid: 5762 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999851:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999861:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999903:0:5755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999912:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999920:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999927:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999933:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044082.999938:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999947:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999956:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044082.999974:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044082.999996:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582946304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 199us (2926us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044083.000002:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00010000:00010000:0.0:1784044083.000775:0:11007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1663200/0x9cc73983a75500f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d7 expref: 12 pid: 5763 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044083.000798:0:11007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11007:1870705598707584:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044083.000813:0:11007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bffa9ba00/0x9cc73983a75500dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead59f expref: 11 pid: 5762 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044083.000821:0:11007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff432a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11007:1870705598707712:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044083.000858:0:11007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044083.000893:0:11007:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044083.000897:0:11007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044083.000917:0:11007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f4200/0x9cc73983a755010e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044083.038609:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044083.067410:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044083.067466:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044083.067497:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044083.067532:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582946560 00000100:00100000:0.0:1784044083.067545:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582946560 00000100:00100000:2.0:1784044083.067580:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582946432 00000100:00100000:2.0:1784044083.067587:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582946432 00000100:00100000:0.0:1784044083.067627:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582946688 00000100:00100000:0.0:1784044083.067632:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582946688 00000100:00100000:2.0:1784044083.067640:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 227 00000100:00100000:0.0:1784044083.067667:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:2.0:1784044083.067670:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+11:2348:x1870705582946432:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044083.067681:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582946560:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044083.067766:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582946560:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 89us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044083.067775:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:0.0:1784044083.067796:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:0.0:1784044083.067804:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2348:x1870705582946688:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044083.067843:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+11:2348:x1870705582946432:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 191us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044083.067855:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 227 00000100:00100000:0.0:1784044083.067857:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2348:x1870705582946688:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 50us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044083.067898:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00080000:3.0:1784044083.068738:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784044084.063970:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044084.346306:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044084.346357:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582946816 00000100:00100000:1.0:1784044084.346366:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582946816 00000100:00100000:1.0:1784044084.346523:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 228 00000100:00100000:1.0:1784044084.346536:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+11:5567:x1870705582946816:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044084.346555:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044084.346791:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904c02176000/0x9cc73983a7550115 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead601 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044084.346837:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904c02176000/0x9cc73983a7550115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead601 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044084.346849:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904c02176000/0x9cc73983a7550115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead601 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044084.346859:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904c02176000, rc 0) 00000100:00100000:1.0:1784044084.346932:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582946816:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 399us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044084.346940:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 228 00000100:00100000:1.0:1784044084.351104:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044084.351140:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582946944 00000100:00100000:1.0:1784044084.351148:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582946944 00000100:00100000:1.0:1784044084.351204:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:1.0:1784044084.351214:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582946944:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044084.352023:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582946944:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 806us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044084.352032:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:1.0:1784044084.355581:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044084.356062:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582947072 00000100:00100000:0.0:1784044084.356073:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582947072 00000100:00100000:0.0:1784044084.356122:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 230 00000100:00100000:0.0:1784044084.356132:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582947072:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044084.356392:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582947072:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 260us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044084.356405:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 230 00000100:00100000:1.0:1784044084.380118:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044084.380204:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582947200 00000100:00100000:0.0:1784044084.380214:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582947200 00000100:00100000:0.0:1784044084.380269:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 231 00000100:00100000:0.0:1784044084.380279:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582947200:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044084.380296:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044084.380313:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee6200/0x9cc73983a755011c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead608 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044084.380349:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee6200/0x9cc73983a755011c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead608 expref: 13 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044084.380361:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee6200/0x9cc73983a755011c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead608 expref: 13 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044084.380371:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6200, rc 0) 00000100:00100000:0.0:1784044084.380424:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:5567:x1870705582947200:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 147us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044084.380431:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 231 00000100:00100000:0.0:1784044084.384076:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044084.384161:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582947328 00000100:00100000:1.0:1784044084.384179:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582947328 00000100:00100000:1.0:1784044084.384235:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 232 00000100:00100000:1.0:1784044084.384245:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:5567:x1870705582947328:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044084.384850:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:5567:x1870705582947328:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 604us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044084.384895:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 232 00000100:00100000:2.0:1784044084.389955:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044084.390333:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582947456 00000100:00100000:1.0:1784044084.390344:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582947456 00000100:00100000:1.0:1784044084.390480:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 233 00000100:00100000:1.0:1784044084.390495:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:5567:x1870705582947456:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044084.391091:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:5567:x1870705582947456:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 597us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044084.391101:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 233 10000000:01000000:2.0:1784044084.832294:0:5766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044084.832301:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bffcb1000 from 7 10000000:01000000:2.0:1784044084.832306:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044084.832352:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.832364:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.832374:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044084.832398:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598708608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.832470:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044084.832519:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7f53780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044084.832543:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598708608 00000100:00100000:2.0:1784044084.832550:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598708608 00000100:00100000:2.0:1784044084.832603:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784044084.832613:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598708608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044084.832630:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044084.832646:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f4c00/0x9cc73983a755012a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7550123 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.832673:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f4c00/0x9cc73983a755012a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7550123 expref: 17 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.832685:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f4c00/0x9cc73983a755012a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7550123 expref: 17 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.832694:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4c00, rc 0) 00000100:00100000:2.0:1784044084.832737:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598708608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044084.832743:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784044084.832811:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598708608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044084.832830:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.832838:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044084.832920:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598708736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.832952:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044084.832967:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7f53780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044084.832982:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598708736 00000100:00100000:2.0:1784044084.832985:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598708736 00000100:00100000:2.0:1784044084.833010:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784044084.833016:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598708736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.833288:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598708736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044084.833295:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784044084.833325:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598708736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.833353:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598708864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.833389:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044084.833401:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7f53780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044084.833413:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598708864 00000100:00100000:2.0:1784044084.833417:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598708864 00000100:00100000:2.0:1784044084.833436:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784044084.833443:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598708864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.833573:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598708864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044084.833579:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784044084.833611:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598708864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784044084.834382:0:11085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784044084.834437:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784044084.834451:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044084.834459:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.834475:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044084.834485:0:5766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044084.834487:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904beee0a000 from 7 10000000:01000000:2.0:1784044084.834489:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044084.834511:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.834518:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.834528:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044084.834544:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598708992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.834581:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044084.834596:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf58adb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044084.834609:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598708992 00000100:00100000:2.0:1784044084.834613:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598708992 00000100:00100000:2.0:1784044084.834637:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784044084.834643:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598708992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044084.834653:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044084.834662:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f5a00/0x9cc73983a7550138 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7550131 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.834678:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f5a00/0x9cc73983a7550138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7550131 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.834699:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f5a00/0x9cc73983a7550138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7550131 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.834706:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5a00, rc 0) 00000100:00100000:2.0:1784044084.834736:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598708992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044084.834742:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784044084.834778:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598708992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044084.834790:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.834797:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044084.834833:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598709120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.834855:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044084.834885:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf58adb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044084.834896:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598709120 00000100:00100000:2.0:1784044084.834899:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598709120 00000100:00100000:2.0:1784044084.834915:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784044084.834920:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598709120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.835083:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598709120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044084.835090:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784044084.835113:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598709120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.835142:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598709248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.843387:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044084.843441:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598709248 00000100:00100000:2.0:1784044084.843450:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598709248 00000100:00100000:2.0:1784044084.843496:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784044084.843505:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598709248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.843719:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598709248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044084.843728:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784044084.843785:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf58adb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044084.843807:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598709248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784044084.850988:0:11087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784044084.851125:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784044084.851471:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044084.851485:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.851498:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044084.851510:0:5766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044084.851513:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bc9af1000 from 7 10000000:01000000:2.0:1784044084.851516:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044084.851558:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.851566:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.851590:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044084.851617:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598709376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.851693:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044084.851788:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf58adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044084.853810:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598709376 00000100:00100000:3.0:1784044084.853826:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598709376 00000100:00100000:2.0:1784044084.854097:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784044084.854109:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598709376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044084.854129:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044084.854294:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f4200/0x9cc73983a7550146 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755013f expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.854326:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f4200/0x9cc73983a7550146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755013f expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.854336:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f4200/0x9cc73983a7550146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755013f expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.854345:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4200, rc 0) 00000100:00100000:2.0:1784044084.854420:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598709376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 313us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044084.854428:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784044084.854529:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598709376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044084.854552:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044084.854576:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044084.854659:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598709504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.854693:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044084.854767:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf58adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044084.854805:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598709504 00000100:00100000:3.0:1784044084.854811:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598709504 00000100:00100000:3.0:1784044084.854960:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1784044084.854977:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598709504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044084.855404:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598709504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 428us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044084.855412:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1784044084.855542:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb439880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598709504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044084.855582:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598709632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044084.855619:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044084.855679:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044084.855710:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598709632 00000100:00100000:2.0:1784044084.855715:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598709632 00000100:00100000:2.0:1784044084.855779:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784044084.855786:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598709632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044084.856518:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598709632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 730us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044084.856528:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1784044084.856681:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598709632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784044084.857752:0:11088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784044084.858028:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784044084.858056:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044084.858068:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044084.858081:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044085.086323:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044086.113903:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044087.136738:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044087.198703:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598709760:0@lo:400:kworker.0 00000100:00100000:3.0:1784044087.198779:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044087.198828:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598710272:0@lo:400:kworker.0 00000100:00100000:3.0:1784044087.198854:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044087.198906:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784044087.198923:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598709888:0@lo:400:kworker.0 00000100:00100000:3.0:1784044087.198946:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044087.198968:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598710400:0@lo:400:kworker.0 00000100:00100000:3.0:1784044087.198994:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044087.199036:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598710016:0@lo:400:kworker.0 00000100:00100000:3.0:1784044087.199059:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044087.199077:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044087.199083:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598710144:0@lo:400:kworker.0 00000100:00100000:3.0:1784044087.199107:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044087.199148:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598709760 00000100:00100000:3.0:1784044087.199156:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598709760 00000100:00100000:3.0:1784044087.199208:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784044087.199216:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598709760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044087.199262:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598709760:12345-0@lo:400:kworker.0 Request processed in 46us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044087.199269:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784044087.199298:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598710400 00000100:00100000:3.0:1784044087.199301:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598710400 00000100:00100000:3.0:1784044087.199330:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598710144 00000100:00100000:3.0:1784044087.199333:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598710144 00000100:00100000:3.0:1784044087.199353:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784044087.199358:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598710400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044087.199387:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598710400:12345-0@lo:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044087.199393:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784044087.199405:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044087.199410:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb6abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598710144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044087.199437:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb6abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598710144:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044087.199451:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1784044087.199619:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff50f800 x1870705598710400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044087.199634:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598710400:0@lo:400:kworker.0 00000100:00100000:3.0:1784044087.199644:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598709760:0@lo:400:kworker.0 00000100:00080000:3.0:1784044087.199665:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044087.199669:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784044087.199686:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff50fb80 x1870705598710144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044087.199696:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598710144:0@lo:400:kworker.0 00000100:00100000:0.0:1784044087.201079:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598710272 00000100:00100000:0.0:1784044087.201090:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598710272 00000100:00100000:0.0:1784044087.201150:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598709888 00000100:00100000:0.0:1784044087.201154:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598709888 00000100:00100000:0.0:1784044087.201170:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598710016 00000100:00100000:0.0:1784044087.201185:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598710016 00000100:00100000:0.0:1784044087.201205:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784044087.201214:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598710272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044087.201296:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598710272:12345-0@lo:400:kworker.0 Request processed in 84us (2441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044087.201304:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784044087.201319:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784044087.201324:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598709888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044087.201348:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598709888:12345-0@lo:400:kworker.0 Request processed in 25us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044087.201354:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784044087.201364:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784044087.201369:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598710016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044087.201409:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598710016:12345-0@lo:400:kworker.0 Request processed in 40us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044087.201415:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1784044087.201440:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044087.201473:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598709888:0@lo:400:kworker.0 00000100:00100000:0.0:1784044087.201485:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598710272:0@lo:400:kworker.0 00000100:00100000:0.0:1784044087.201515:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598710016:0@lo:400:kworker.0 00000100:00100000:0.0:1784044087.202883:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044087.202902:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598710528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044087.202964:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044087.203216:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598710528 00000100:00100000:3.0:1784044087.203223:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598710528 00000100:00100000:3.0:1784044087.203276:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784044087.203285:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598710528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044087.203318:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044087.203364:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598710528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044087.203371:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1784044087.203417:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb438e00 x1870705598710528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044087.203436:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598710528:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1784044087.595265:0:11205:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784044087.712535:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044087.712561:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598710656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044087.712635:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044087.712733:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598710656 00000100:00100000:3.0:1784044087.712741:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598710656 00000100:00100000:3.0:1784044087.712800:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784044087.712828:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598710656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044087.712904:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044087.712955:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598710656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044087.712964:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1784044087.713056:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff50fb80 x1870705598710656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044087.713076:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598710656:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784044088.160124:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044088.196901:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044088.196951:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044088.196981:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044088.197074:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582947840 00000100:00100000:3.0:1784044088.197083:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582947840 00000100:00100000:3.0:1784044088.197156:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582947712 00000100:00100000:3.0:1784044088.197160:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582947712 00000100:00100000:3.0:1784044088.197184:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00080000:2.0:1784044088.197217:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044088.197256:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2348:x1870705582947840:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044088.197345:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2348:x1870705582947840:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 152us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044088.197718:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582947584 00000100:00100000:0.0:1784044088.197723:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582947584 00000100:00100000:0.0:1784044088.197770:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 244 00000100:00100000:0.0:1784044088.197791:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2348:x1870705582947584:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044088.197821:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2348:x1870705582947584:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 33us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044088.197828:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 244 00000100:00100000:1.0:1784044088.199968:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:1.0:1784044088.199992:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582947712:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044088.200432:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582947712:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 447us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.200441:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:3.0:1784044088.203508:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 87 00010000:00010000:2.0:1784044089.192299:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044090.212400:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044091.230163:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044092.259499:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044092.318334:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598710784:0@lo:400:kworker.0 00000100:00100000:0.0:1784044092.318413:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044092.318463:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044092.318468:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598710912:0@lo:400:kworker.0 00000100:00100000:0.0:1784044092.318505:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044092.318532:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598711168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044092.318555:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044092.318572:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044092.318577:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598711040:0@lo:400:kworker.0 00000100:00100000:0.0:1784044092.318594:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044092.318622:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598710784 00000100:00100000:0.0:1784044092.318629:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598710784 00000100:00100000:0.0:1784044092.318673:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1784044092.318681:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598710784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044092.318724:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598710784:12345-0@lo:400:kworker.0 Request processed in 43us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044092.318731:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1784044092.318758:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598710912 00000100:00100000:0.0:1784044092.318761:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598710912 00000100:00100000:0.0:1784044092.318780:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598711040 00000100:00100000:0.0:1784044092.318782:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598711040 00000100:00100000:0.0:1784044092.318803:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784044092.318819:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598710912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044092.318846:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598710912:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044092.318852:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784044092.318884:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784044092.318890:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598711040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044092.318930:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598711040:12345-0@lo:400:kworker.0 Request processed in 40us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044092.318936:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784044092.318953:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598711168 00000100:00100000:0.0:1784044092.318956:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598711168 00000100:00100000:0.0:1784044092.318982:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784044092.318989:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598711168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044092.319030:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044092.319062:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598711168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044092.319068:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044092.319382:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598711424:0@lo:400:kworker.0 00000100:00100000:3.0:1784044092.319415:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044092.319439:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044092.319444:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598711296:0@lo:400:kworker.0 00000100:00100000:3.0:1784044092.319466:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044092.319505:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598711552:0@lo:400:kworker.0 00000100:00100000:3.0:1784044092.319530:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044092.319558:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598711296 00000100:00100000:3.0:1784044092.319562:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598711296 00000100:00100000:3.0:1784044092.319587:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598711552 00000100:00100000:3.0:1784044092.319589:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598711552 00000100:00100000:3.0:1784044092.319608:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784044092.319625:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598711296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044092.319659:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598711296:12345-0@lo:400:kworker.0 Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044092.319665:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784044092.319676:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784044092.319681:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598711552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044092.319711:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598711552:12345-0@lo:400:kworker.0 Request processed in 30us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044092.319716:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1784044092.319758:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff50f100 x1870705598711552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044092.319772:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598711552:0@lo:400:kworker.0 00010000:00080000:3.0:1784044092.319807:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff50ea00 x1870705598711296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044092.319815:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598711296:0@lo:400:kworker.0 00000100:00080000:1.0:1784044092.320066:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044092.320071:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784044092.320074:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044092.320289:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598711424 00000100:00100000:0.0:1784044092.320296:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598711424 00000100:00100000:0.0:1784044092.320324:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784044092.320332:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598711424:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784044092.321313:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044092.321385:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598710912:0@lo:400:kworker.0 00000100:00100000:1.0:1784044092.321400:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598710784:0@lo:400:kworker.0 00000100:00100000:1.0:1784044092.321460:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598711040:0@lo:400:kworker.0 00010000:00080000:1.0:1784044092.321477:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5c4c700 x1870705598711168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044092.321511:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598711168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044092.322291:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598711424:12345-0@lo:400:kworker.0 Request processed in 1953us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044092.322302:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784044092.328816:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598711424:0@lo:400:kworker.0 00000001:02000400:1.0:1784044092.483248:0:11305:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 11:48:10 (1784044090) === 00000100:00100000:2.0:1784044092.782757:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044092.782808:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044092.783124:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582947968 00000100:00100000:0.0:1784044092.783134:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582947968 00000100:00100000:0.0:1784044092.783244:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1784044092.783255:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582947968:12345-192.168.204.50@tcp:41:mkdir.0 00000004:00000024:0.0:1784044092.783307:0:7482:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784044092.783409:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582947968:12345-192.168.204.50@tcp:41:mkdir.0 Request processed in 155us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044092.783417:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00080000:2.0:1784044092.783553:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044092.784948:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582948096 00000100:00100000:1.0:1784044092.784964:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582948096 00000100:00100000:1.0:1784044092.785038:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:1.0:1784044092.785050:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:9649:x1870705582948096:12345-192.168.204.50@tcp:700:mkdir.0 00000100:00100000:1.0:1784044092.785134:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:9649:x1870705582948096:12345-192.168.204.50@tcp:700:mkdir.0 Request processed in 85us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044092.785141:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1784044092.804904:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044092.804972:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582948352 00000100:00100000:1.0:1784044092.804990:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582948352 00000100:00100000:1.0:1784044092.805230:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1784044092.805247:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:9649:x1870705582948352:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:1.0:1784044092.805340:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044092.807808:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a755002e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead58a expref: 6 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.807855:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e200) 00010000:00010000:1.0:1784044092.807901:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044092.808198:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a755014d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.808212:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a755014d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.808222:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a755014d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.808257:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.808266:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.808274:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044092.811962:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784044092.811986:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a755014d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.811997:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a755014d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.812014:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a755014d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.812021:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904c02177400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044092.812033:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a755014d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.812041:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a755014d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.812058:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:1.0:1784044092.812061:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044092.812066:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a755014d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.812073:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a755014d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044092.812095:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000298fa18e reply state 00000000223015b8 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044092.812104:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044092.815280:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:9649:x1870705582948352:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 10023us (10414us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784044092.815294:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00010000:00010000:1.0:1784044092.827775:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.827799:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.827808:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.827816:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904c02177e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044092.827822:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.827849:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.827925:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff904bc5fdb000) 00010000:00010000:1.0:1784044092.827929:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044092.827935:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.827941:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550154 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044092.831454:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598711680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044092.831586:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044092.832108:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598711680 00000100:00100000:3.0:1784044092.832120:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598711680 00000100:00100000:3.0:1784044092.832198:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784044092.832210:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598711680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044092.832260:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044092.832336:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598711680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044092.832343:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1784044092.832459:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff50dc00 x1870705598711680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044092.832485:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598711680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044092.863372:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044092.863491:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582948480 00000100:00100000:3.0:1784044092.863505:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582948480 00000100:00100000:3.0:1784044092.863584:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1784044092.863595:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:9650:x1870705582948480:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:3.0:1784044092.863634:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044092.863669:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a755015b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead60f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.863764:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550162 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.863781:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.863798:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044092.863941:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784044092.863946:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044092.863998:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.864042:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a755015b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead60f expref: 8 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.864065:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead60f expref: 7 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.864075:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e000) 00010000:00010000:3.0:1784044092.864078:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044092.864100:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b800, rc 0) 00000100:00100000:3.0:1784044092.864185:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:9650:x1870705582948480:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 590us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044092.864193:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:2.0:1784044092.872713:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044092.872846:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582948736 00000100:00100000:0.0:1784044092.872953:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582948736 00000100:00100000:0.0:1784044092.873096:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:0.0:1784044092.873109:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:9650:x1870705582948736:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:0.0:1784044092.873201:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044092.873239:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550162 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead60f expref: 7 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044092.873267:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e000) 00010000:00010000:0.0:1784044092.873282:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044092.873322:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044092.873339:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044092.873352:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044092.873838:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006937aa59 reply state 00000000d88f29cb transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044092.873851:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784044092.873987:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1784044092.874186:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:9650:x1870705582948736:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 1076us (1662us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784044092.874196:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00010000:00010000:3.0:1784044092.889974:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.890000:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.890021:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.890030:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044092.890035:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.890043:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.890073:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59ae00) 00010000:00010000:3.0:1784044092.890077:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784044092.890082:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.890089:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550169 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044092.921457:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044092.921857:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582948864 00000100:00100000:3.0:1784044092.921917:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582948864 00000100:00100000:3.0:1784044092.921988:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:3.0:1784044092.922000:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:9651:x1870705582948864:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:3.0:1784044092.922055:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044092.922206:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550170 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead616 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.922311:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a7550177 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.922330:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a7550177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.922344:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a7550177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044092.922426:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784044092.922431:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044092.922482:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a7550177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.922514:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead616 expref: 9 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.922754:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a7550177 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead616 expref: 8 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.922767:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e500) 00010000:00010000:3.0:1784044092.922770:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044092.922774:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b200, rc 0) 00000100:00100000:3.0:1784044092.923520:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:9651:x1870705582948864:12345-192.168.204.50@tcp:101:chown.0 Request processed in 1514us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044092.923542:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:2.0:1784044092.930413:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044092.930507:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582948992 00000100:00100000:1.0:1784044092.930522:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582948992 00000100:00100000:1.0:1784044092.930826:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1784044092.930840:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:9651:x1870705582948992:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:1.0:1784044092.930906:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044092.930937:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a755017e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead61d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931042:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550185 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931061:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550185 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931097:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550185 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931147:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755018c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931156:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755018c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931164:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755018c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931310:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550193 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931319:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931327:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044092.931381:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1784044092.931386:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044092.931417:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931430:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550185 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931437:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550185 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931444:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550185 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931462:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904c02177400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044092.931467:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550185 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931476:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550185 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931492:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e500) 00010000:00010000:1.0:1784044092.931496:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044092.931502:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550185 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931509:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931536:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755018c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931543:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755018c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931550:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755018c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931555:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044092.931557:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755018c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931563:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755018c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931582:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff904bc5fdb000) 00010000:00010000:1.0:1784044092.931584:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044092.931587:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755018c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.931593:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755018c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.933281:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a755017e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead61d expref: 10 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.933318:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550193 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead61d expref: 9 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044092.933328:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:1.0:1784044092.933331:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044092.933334:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662200, rc 0) 00000100:00100000:1.0:1784044092.933479:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:9651:x1870705582948992:12345-192.168.204.50@tcp:101:chown.0 Request processed in 2640us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044092.933489:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1784044092.944160:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044092.944308:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582949248 00000100:00100000:3.0:1784044092.944324:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582949248 00000100:00100000:3.0:1784044092.944400:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:3.0:1784044092.944412:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:9651:x1870705582949248:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:3.0:1784044092.944489:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044092.944541:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550193 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead61d expref: 9 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.944567:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:3.0:1784044092.944583:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044092.944628:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.944644:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044092.944656:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044093.006374:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1784044093.006408:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1784044093.010802:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dfdc3600 reply state 0000000092b1c7b2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044093.010829:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784044093.011422:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1784044093.016144:0:5770:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784044093.016187:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:9651:x1870705582949248:12345-192.168.204.50@tcp:36:chown.0 Request processed in 71763us (72031us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1784044093.016227:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00010000:00010000:0.0:1784044093.016699:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.016718:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.016728:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.016737:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044093.016744:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.016755:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.016790:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc7c1ee00) 00010000:00010000:0.0:1784044093.016794:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784044093.016801:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.016809:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a755019a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044093.077058:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044093.077192:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582949376 00000100:00100000:0.0:1784044093.077208:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582949376 00000100:00100000:1.0:1784044093.077379:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1784044093.077392:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:9652:x1870705582949376:12345-192.168.204.50@tcp:101:touch.500 00010000:00010000:1.0:1784044093.077423:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044093.077454:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a75501a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead624 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044093.081652:0:5771:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4131us 00010000:00010000:1.0:1784044093.102712:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75501a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.102744:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75501a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.102760:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75501a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.102779:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75501af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.102787:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75501af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.102895:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75501af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.103415:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75501b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.103439:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75501b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.103448:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75501b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044093.111495:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784044093.111508:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044093.111780:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75501b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112018:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75501a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112028:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75501a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112036:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75501a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112044:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044093.112050:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75501a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112059:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75501a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112080:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e500) 00010000:00010000:1.0:1784044093.112084:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044093.112090:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75501a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112109:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75501a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112127:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75501af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112134:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75501af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112140:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75501af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112145:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044093.112149:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75501af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112155:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75501af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112165:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff904bc5fdbf00) 00010000:00010000:1.0:1784044093.112168:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044093.112171:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75501af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112177:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75501af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112237:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a75501a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead624 expref: 8 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112255:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75501b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead624 expref: 7 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.112270:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc5fdb000) 00010000:00010000:1.0:1784044093.112273:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784044093.112275:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663800, rc 0) 00000100:00100000:1.0:1784044093.112379:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:9652:x1870705582949376:12345-192.168.204.50@tcp:101:touch.500 Request processed in 34987us (35337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044093.112390:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:3.0:1784044093.118910:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044093.119126:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582949632 00000100:00100000:1.0:1784044093.119140:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582949632 00000100:00100000:1.0:1784044093.119230:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:1.0:1784044093.119243:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:9652:x1870705582949632:12345-192.168.204.50@tcp:101:touch.500 00010000:00010000:1.0:1784044093.119271:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044093.119301:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75501bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead62b expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.119732:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75501c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.119758:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75501c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.119773:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75501c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.120039:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.120062:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.120089:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044093.121164:0:7482:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1784044093.121419:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a75501d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121432:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a75501d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121442:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a75501d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121475:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75501c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121482:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75501c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121489:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75501c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121494:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904c02177e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044093.121499:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75501c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121506:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75501c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121517:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc5fdb000) 00010000:00010000:1.0:1784044093.121519:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044093.121529:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75501c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121536:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75501c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044093.121549:0:7482:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008a7f58a6 reply state 000000001fdd1eab transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044093.121558:0:7482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784044093.121593:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75501bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead62b expref: 10 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121607:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a75501d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead62b expref: 9 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.121614:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff904bc5fdbb00) 00010000:00010000:1.0:1784044093.121616:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044093.121619:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1678c00, rc 0) 00000100:00100000:1.0:1784044093.121703:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:9652:x1870705582949632:12345-192.168.204.50@tcp:101:touch.500 Request processed in 2463us (2840us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784044093.121712:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00010000:00010000:0.0:1784044093.129763:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.129783:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.129792:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.129798:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904c02177400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044093.129803:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.129810:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.129828:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa11b4155 (ffff904bc5fdb100) 00010000:00010000:0.0:1784044093.129831:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044093.129836:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.129843:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75501cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044093.139482:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044093.139578:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582949888 00000100:00100000:0.0:1784044093.139592:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582949888 00000100:00100000:0.0:1784044093.139654:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:0.0:1784044093.139664:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:9652:x1870705582949888:12345-192.168.204.50@tcp:36:touch.500 00010000:00010000:0.0:1784044093.139737:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044093.139764:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1678c00/0x9cc73983a75501d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead62b expref: 9 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.139783:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff904bc5fdbb00) 00010000:00010000:0.0:1784044093.139793:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044093.139833:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.139846:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.139857:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044093.140180:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e083ce95 reply state 00000000c34e5d88 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044093.140196:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044093.140331:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:9652:x1870705582949888:12345-192.168.204.50@tcp:36:touch.500 Request processed in 665us (862us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784044093.140342:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00010000:00010000:3.0:1784044093.141649:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.141667:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.141675:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.141681:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044093.141704:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.141713:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.141731:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff904bda59a400) 00010000:00010000:3.0:1784044093.141735:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044093.141740:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.141747:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75501e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044093.143822:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044093.143924:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582950016 00000100:00100000:1.0:1784044093.143939:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582950016 00000100:00100000:3.0:1784044093.144103:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:3.0:1784044093.144126:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:9652:x1870705582950016:12345-192.168.204.50@tcp:101:touch.500 00010000:00010000:3.0:1784044093.144166:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044093.144199:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75501e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead632 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.144284:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75501e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead632 expref: 10 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.144301:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75501e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead632 expref: 10 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.144326:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff904bc7c1ed00) 00010000:00010000:3.0:1784044093.144329:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044093.144350:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9bc00, rc 0) 00000100:00100000:3.0:1784044093.144426:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:9652:x1870705582950016:12345-192.168.204.50@tcp:101:touch.500 Request processed in 311us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044093.144435:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:2.0:1784044093.154338:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044093.160674:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582950144 00000100:00100000:3.0:1784044093.160699:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582950144 00000100:00100000:3.0:1784044093.160862:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1784044093.160890:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1870705582950144:12345-192.168.204.50@tcp:8:touch.500 00010000:00080000:3.0:1784044093.160936:0:6572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:3.0:1784044093.160996:0:6572:0:(genops.c:1406:class_connect()) connect: client 3609c122-577c-43fa-ab52-dd2c7dc5cce7, cookie 0x9cc73983a75501ee 00002000:00100000:3.0:1784044093.161026:0:6572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3609c122-577c-43fa-ab52-dd2c7dc5cce7/ffff904bed245000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784044093.161042:0:6572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784044093.161368:0:6572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784044093.161410:0:6572:0:(import.c:65:import_set_state_nolock()) ffff904bed244000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044093.161513:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2344:x1870705582950144:12345-192.168.204.50@tcp:8:touch.500 Request processed in 622us (7189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044093.164076:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1784044093.171018:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044093.171230:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582950272 00000100:00100000:3.0:1784044093.171240:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582950272 00000100:00100000:3.0:1784044093.171426:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:3.0:1784044093.171437:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:0:x1870705582950272:12345-192.168.204.50@tcp:2:touch.500 00000100:00080000:2.0:1784044093.187971:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1784044093.269370:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1784044093.269397:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000100:00100000:0.0:1784044093.269966:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:0:x1870705582950272:12345-192.168.204.50@tcp:2:touch.500 Request processed in 98520us (98954us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784044093.269982:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1784044093.274840:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044093.275267:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582950528 00000100:00100000:3.0:1784044093.275281:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582950528 00000100:00100000:3.0:1784044093.275347:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:3.0:1784044093.275358:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:9652:x1870705582950528:12345-192.168.204.50@tcp:35:touch.500 00000100:00100000:3.0:1784044093.275808:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+11:9652:x1870705582950528:12345-192.168.204.50@tcp:35:touch.500 Request processed in 450us (981us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784044093.275834:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00010000:00010000:2.0:1784044093.278776:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044093.299551:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044093.299758:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582950656 00000100:00100000:1.0:1784044093.299771:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582950656 00000100:00100000:1.0:1784044093.299857:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:1.0:1784044093.299907:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+11:9653:x1870705582950656:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:1.0:1784044093.299939:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044093.299966:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1679e00/0x9cc73983a75501f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead639 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.300525:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a75501fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.300546:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a75501fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.300559:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a75501fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044093.300642:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784044093.300647:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044093.300712:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a75501fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.300746:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1679e00/0x9cc73983a75501f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead639 expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.300769:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a75501fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead639 expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.300779:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc5fdb000) 00010000:00010000:0.0:1784044093.300782:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044093.300798:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6600, rc 0) 00000100:00100000:0.0:1784044093.301108:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+12:9653:x1870705582950656:12345-192.168.204.50@tcp:101:rm.0 Request processed in 1202us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044093.301117:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:0.0:1784044093.305695:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044093.305776:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582950912 00000100:00100000:3.0:1784044093.305798:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582950912 00000100:00100000:3.0:1784044093.305920:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:3.0:1784044093.305931:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+12:9653:x1870705582950912:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1784044093.305958:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044093.305988:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead640 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044093.306168:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1784044093.306373:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550203 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead640 expref: 14 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.306391:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e500) 00010000:00010000:3.0:1784044093.306394:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044093.306400:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead640 expref: 14 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.306415:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a400, rc 0) 00000100:00100000:3.0:1784044093.306483:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:9653:x1870705582950912:12345-192.168.204.50@tcp:101:rm.0 Request processed in 554us (803us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1784044093.306491:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:2.0:1784044093.308852:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044093.309723:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582951040 00000100:00100000:1.0:1784044093.309737:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582951040 00000100:00100000:1.0:1784044093.310053:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 246 00000100:00100000:0.0:1784044093.310226:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044093.310510:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582951040:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044093.310612:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582951040:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 108us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.310835:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582951168 00000100:00100000:2.0:1784044093.310850:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582951168 00000100:00100000:2.0:1784044093.310926:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:2.0:1784044093.310934:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582951168:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044093.310974:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582951168:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.310982:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00080000:0.0:1784044093.312055:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044093.321083:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 246 00000100:00100000:0.0:1784044093.322469:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044093.323134:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582951296 00000100:00100000:3.0:1784044093.323148:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582951296 00000100:00100000:3.0:1784044093.323232:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:3.0:1784044093.323245:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:9653:x1870705582951296:12345-192.168.204.50@tcp:37:rm.0 00000100:00100000:2.0:1784044093.332394:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:9653:x1870705582951296:12345-192.168.204.50@tcp:37:rm.0 Request processed in 9133us (9917us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.332429:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1784044093.339693:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044093.339957:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582951552 00000100:00100000:2.0:1784044093.339972:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582951552 00000100:00100000:2.0:1784044093.340138:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:2.0:1784044093.340152:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfecd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:9653:x1870705582951552:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:2.0:1784044093.340640:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfecd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:9653:x1870705582951552:12345-192.168.204.50@tcp:35:rm.0 Request processed in 490us (961us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784044093.340649:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:0.0:1784044093.345382:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044093.345502:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582951808 00000100:00100000:3.0:1784044093.345638:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582951808 00000100:00100000:3.0:1784044093.345753:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:3.0:1784044093.345776:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:9653:x1870705582951808:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1784044093.345816:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044093.345845:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead647 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.346076:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550218 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.346095:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550218 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044093.346110:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550218 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044093.346124:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784044093.346663:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead647 expref: 17 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.346692:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550218 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead647 expref: 16 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.346702:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc5fdb000) 00010000:00010000:2.0:1784044093.346705:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784044093.346709:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b800, rc 0) 00000100:00100000:2.0:1784044093.346950:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:9653:x1870705582951808:12345-192.168.204.50@tcp:101:rm.0 Request processed in 1185us (1581us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784044093.346960:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:3.0:1784044093.351407:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044093.351602:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582951936 00000100:00100000:1.0:1784044093.351616:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582951936 00000100:00100000:1.0:1784044093.351695:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:1.0:1784044093.351708:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:9653:x1870705582951936:12345-192.168.204.50@tcp:41:rm.0 00000004:00000024:0.0:1784044093.352366:0:5771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1784044093.352479:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:9653:x1870705582951936:12345-192.168.204.50@tcp:41:rm.0 Request processed in 770us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044093.352490:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:0.0:1784044093.356610:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044093.356727:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582952064 00000100:00100000:1.0:1784044093.356741:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582952064 00000100:00100000:2.0:1784044093.357360:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:2.0:1784044093.357378:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:9653:x1870705582952064:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1784044093.357404:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044093.357432:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550226 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead64e expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357566:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755022d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357585:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755022d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357604:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755022d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357622:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7550234 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357630:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7550234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357637:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7550234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357852:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755023b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357860:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755023b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357892:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755023b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044093.357925:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784044093.357930:0:7482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044093.357952:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755023b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357978:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755023b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.357988:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755022d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358007:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755022d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358017:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755022d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358024:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044093.358030:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755022d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358039:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755022d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358052:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc5fdb000) 00010000:00010000:2.0:1784044093.358055:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044093.358070:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755022d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358077:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755022d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358090:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7550234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358097:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7550234 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358109:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7550234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358115:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044093.358118:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7550234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358124:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7550234 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358131:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa11b4155 (ffff904bd19d5400) 00010000:00010000:2.0:1784044093.358133:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044093.358136:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7550234 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358142:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7550234 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358183:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550226 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead64e expref: 18 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358198:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755023b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead64e expref: 17 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044093.358206:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff904bc7c1ed00) 00010000:00010000:2.0:1784044093.358208:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044093.358211:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5800, rc 0) 00000100:00100000:2.0:1784044093.358287:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:9653:x1870705582952064:12345-192.168.204.50@tcp:101:rm.0 Request processed in 915us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.358303:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:3.0:1784044093.365656:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044093.366277:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582952320 00000100:00100000:0.0:1784044093.366292:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582952320 00000100:00100000:0.0:1784044093.366379:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:0.0:1784044093.366409:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:9653:x1870705582952320:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:0.0:1784044093.366491:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784044093.366540:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755023b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead64e expref: 17 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.366571:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75501e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead632 expref: 16 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.366584:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff904bc7c1ed00) 00010000:00010000:0.0:1784044093.366604:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a75501fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead639 expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.366614:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc5fdb000) 00010000:00010000:0.0:1784044093.366617:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044093.366643:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550242 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.366659:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550242 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.366669:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550242 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.366699:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.366707:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.366713:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.367492:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550250 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.367507:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550250 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.367528:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550250 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044093.369509:0:5771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1784044093.369641:0:5771:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 271354776109ns, next at 272354771185ns, rc = 0 00010000:00010000:0.0:1784044093.369985:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370019:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370034:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370046:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370054:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370324:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370426:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044093.370460:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550250 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370482:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550250 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370489:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550250 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370497:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044093.370502:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550250 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370511:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550250 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370596:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff904bda59a900) 00010000:00010000:0.0:1784044093.370601:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784044093.370606:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550250 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370612:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550250 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370637:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550242 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370643:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550242 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370650:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550242 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370655:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044093.370665:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550242 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370672:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550242 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.370750:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc5fdb000) 00010000:00010000:0.0:1784044093.370754:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044093.370758:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550242 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.371125:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550242 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044093.371138:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087e291c3 reply state 000000007eba8146 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044093.371149:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044093.371499:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:9653:x1870705582952320:12345-192.168.204.50@tcp:36:rm.0 Request processed in 5084us (5850us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784044093.371511:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00010000:00010000:1.0:1784044093.372227:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044093.372239:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.372249:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6a00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044093.372254:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.372263:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.372280:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff904bda59a900) 00010000:00010000:1.0:1784044093.372283:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784044093.372288:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044093.372311:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550257 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.375061:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044093.375073:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044093.375077:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044093.378561:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044093.379599:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582952576 00000100:00100000:2.0:1784044093.379615:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582952576 00000100:00100000:2.0:1784044093.380405:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:2.0:1784044093.380423:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:9653:x1870705582952576:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:2.0:1784044093.381331:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:9653:x1870705582952576:12345-192.168.204.50@tcp:35:rm.0 Request processed in 908us (2779us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784044093.381343:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00010000:00010000:0.0:1784044093.384561:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.384606:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.384615:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.384651:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044093.384658:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.384667:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.384702:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa11b4155 (ffff904bda59a600) 00010000:00010000:0.0:1784044093.384706:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044093.384712:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.384720:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550249 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044093.386831:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044093.387008:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582952832 00000100:00100000:0.0:1784044093.387023:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582952832 00000100:00100000:0.0:1784044093.387114:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:0.0:1784044093.387127:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:9653:x1870705582952832:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:0.0:1784044093.387230:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784044093.387270:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b800/0x9cc73983a7550218 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead647 expref: 16 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.387298:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75501b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead624 expref: 15 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.387312:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bc5fdb000) 00010000:00010000:0.0:1784044093.387331:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a7550177 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead616 expref: 14 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.387358:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e500) 00010000:00010000:0.0:1784044093.387365:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044093.387395:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a755025e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.387408:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a755025e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.387419:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a755025e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.387433:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.387440:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.387447:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.388248:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a755026c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.388261:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a755026c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.388270:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a755026c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044093.391711:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1784044093.391745:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a755026c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392013:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a755026c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392022:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a755026c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392030:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044093.392035:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a755026c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392046:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a755026c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392132:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff904bda59ae00) 00010000:00010000:0.0:1784044093.392136:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784044093.392142:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a755026c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392150:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a755026c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392260:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a755025e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392267:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a755025e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392274:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a755025e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392280:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044093.392290:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a755025e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392297:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a755025e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392305:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:0.0:1784044093.392308:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044093.392311:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a755025e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.392318:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a755025e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044093.392332:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4629b24 reply state 0000000053b4ae53 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044093.392343:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044093.392663:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:9653:x1870705582952832:12345-192.168.204.50@tcp:36:rm.0 Request processed in 5531us (5840us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784044093.392675:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00010000:00010000:0.0:1784044093.406171:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.406197:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.406206:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.406214:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044093.406221:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.406251:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.406274:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff904bda59a400) 00010000:00010000:0.0:1784044093.406277:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044093.406283:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044093.406291:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550265 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044094.303175:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044095.325969:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044096.354598:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044097.376531:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784044097.438650:0:6889:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 275423781982ns, next at 276423777722ns, rc = 0 00000100:00100000:1.0:1784044097.438690:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044097.438723:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598711808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044097.439395:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598712064:0@lo:400:kworker.0 00000100:00100000:2.0:1784044097.439470:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044097.439544:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598712576:0@lo:400:kworker.0 00000100:00100000:2.0:1784044097.439599:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044097.439636:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044097.439642:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598712192:0@lo:400:kworker.0 00000100:00100000:2.0:1784044097.439668:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044097.439708:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598712064 00000100:00100000:2.0:1784044097.439718:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598712064 00000100:00100000:1.0:1784044097.439914:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044097.439955:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598711936:0@lo:400:kworker.0 00000100:00100000:1.0:1784044097.439992:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044097.440017:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598712448:0@lo:400:kworker.0 00000100:00100000:1.0:1784044097.440047:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044097.440079:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044097.440086:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598712320:0@lo:400:kworker.0 00000100:00100000:1.0:1784044097.440112:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044097.441153:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598712576 00000100:00100000:3.0:1784044097.441164:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598712576 00000100:00100000:3.0:1784044097.441231:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598712320 00000100:00100000:3.0:1784044097.441235:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598712320 00000100:00100000:3.0:1784044097.441267:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044097.441278:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598712576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044097.441374:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598712576:12345-0@lo:400:kworker.0 Request processed in 98us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044097.441393:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044097.441414:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044097.441420:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598712320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044097.441455:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598712320:12345-0@lo:400:kworker.0 Request processed in 35us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044097.441461:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1784044097.441482:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044097.441487:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044097.441616:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598711808 00000100:00100000:1.0:1784044097.441622:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598711808 00000100:00100000:1.0:1784044097.441660:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044097.441669:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598711808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044097.441712:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044097.441755:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598711808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044097.441761:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1784044097.441992:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0233b80 x1870705598712576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044097.442012:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598712576:0@lo:400:kworker.0 00000100:00100000:1.0:1784044097.442724:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598711936 00000100:00100000:1.0:1784044097.442734:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598711936 00000100:00100000:2.0:1784044097.442880:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598712192 00000100:00100000:2.0:1784044097.442886:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598712192 00000100:00100000:2.0:1784044097.442934:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598712448 00000100:00100000:2.0:1784044097.442938:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598712448 00000100:00100000:2.0:1784044097.442957:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784044097.442966:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598712064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044097.443050:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598712064:12345-0@lo:400:kworker.0 Request processed in 85us (3581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044097.443073:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784044097.443090:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784044097.443095:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598712192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784044097.443312:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044097.443364:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598712064:0@lo:400:kworker.0 00000100:00100000:1.0:1784044097.443963:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1784044097.443977:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc531e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598711936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044097.444039:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc531e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598711936:12345-0@lo:400:kworker.0 Request processed in 68us (4047us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044097.444046:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1784044097.444090:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784044097.444099:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598712448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044097.449643:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598712192:12345-0@lo:400:kworker.0 Request processed in 6532us (9959us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044097.449675:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1784044097.449850:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0230700 x1870705598712320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044097.449917:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598712320:0@lo:400:kworker.0 00000100:00100000:3.0:1784044097.449958:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598712192:0@lo:400:kworker.0 00000100:00100000:2.0:1784044097.449961:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598711936:0@lo:400:kworker.0 00010000:00080000:2.0:1784044097.449983:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5440700 x1870705598711808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044097.450007:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598711808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044097.451340:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598712448:12345-0@lo:400:kworker.0 Request processed in 7227us (11277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044097.451365:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784044097.452018:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598712448:0@lo:400:kworker.0 00000100:00100000:2.0:1784044097.975701:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598712704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044097.975805:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044097.976078:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598712704 00000100:00100000:2.0:1784044097.976090:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598712704 00000100:00100000:2.0:1784044097.976149:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784044097.976160:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598712704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044097.976209:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044097.977015:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598712704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 850us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044097.977035:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1784044097.977096:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff50f800 x1870705598712704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044097.977121:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598712704:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1784044098.046315:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1784044098.046344:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1784044098.046358:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:3.0:1784044098.046853:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598712832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784044098.047000:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044098.047224:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598712832 00000100:00100000:1.0:1784044098.047235:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598712832 00000100:00100000:1.0:1784044098.047402:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784044098.047415:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598712832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784044098.047453:0:6572:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1784044098.047504:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a565a3d, atime: 0x6a565a3d, ctime: 0x6a565a3d, blocks: 0x1 00010000:00010000:1.0:1784044098.047513:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ae0e1fc/0x9cc73983a7550273 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044098.047535:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=276s v=(0 0) 00010000:00010000:1.0:1784044098.047541:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044098.047549:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae0e1fc/0x9cc73983a7550273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044098.047570:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ae0e1fc/0x9cc73983a7550273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044098.047581:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ae0e1fc/0x9cc73983a7550273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044098.047608:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ae0e1fc/0x9cc73983a7550273 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044098.047633:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044098.048535:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044098.048549:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ae0e1fc/0x9cc73983a7550273 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044098.048563:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1679200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044098.048569:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae0e1fc/0x9cc73983a7550273 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044098.048579:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae0e1fc/0x9cc73983a7550273 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044098.048609:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ae0e1fc/0x9cc73983a7550273 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044098.048628:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ae0e1fc/0x9cc73983a7550273 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044098.048657:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044098.048659:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044098.048661:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044098.049298:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1870705598712832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1881us (2293us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784044098.049310:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1784044098.049702:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904bed281180/2, rc 0, transno 4294967300 00000100:00100000:0.0:1784044098.049712:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598712832:0@lo:6:osp-syn-0-0.0 00000001:02000400:1.0:1784044098.339719:0:11456:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1784044098.403258:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044098.436238:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044098.436292:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044098.436342:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582953216 00000100:00100000:2.0:1784044098.436356:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582953216 00000100:00100000:2.0:1784044098.436495:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:2.0:1784044098.436508:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582953216:12345-192.168.204.50@tcp:400:kworker.0 00000100:00080000:3.0:1784044098.436579:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044098.436607:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582953216:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 101us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044098.436616:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:3.0:1784044098.436647:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044098.436675:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582953088 00000100:00100000:2.0:1784044098.436680:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582953088 00000100:00100000:2.0:1784044098.436724:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:2.0:1784044098.436732:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582953088:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044098.436774:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582953088:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044098.436782:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00080000:2.0:1784044098.436803:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044098.436897:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044098.436931:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582953344 00000100:00100000:2.0:1784044098.436936:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582953344 00000100:00100000:2.0:1784044098.436977:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:2.0:1784044098.436999:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2345:x1870705582953344:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044098.437043:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2345:x1870705582953344:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 45us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044098.437050:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00080000:2.0:1784044098.437065:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044098.438016:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582952960 00000100:00100000:0.0:1784044098.438028:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582952960 00000100:00100000:0.0:1784044098.438080:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 248 00000100:00100000:0.0:1784044098.438089:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582952960:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044098.438155:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582952960:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 68us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044098.438164:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 248 00000001:00080000:2.0:1784044098.545044:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1784044099.425455:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784044099.516232:0:11508:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce1ba8290 20000000:00000080:0.0:1784044099.516259:0:11508:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff904bf566e000 uarg=0000000000000000 20000000:01000000:0.0:1784044099.516307:0:11508:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1784044099.516316:0:11508:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1784044099.516323:0:11508:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1784044099.517431:0:11509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1784044099.517598:0:11508:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1784044099.525616:0:11508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1784044099.525692:0:11508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1784044099.525765:0:11508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1784044099.525788:0:11508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784044099.525831:0:11508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.525857:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904c02176000/0x9cc73983a7550115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead601 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.525910:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904beeee6200/0x9cc73983a755011c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead608 expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.525918:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc81f4c00/0x9cc73983a755012a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7550123 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.525925:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc81f5a00/0x9cc73983a7550138 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7550131 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.525933:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc81f4200/0x9cc73983a7550146 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755013f expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.526120:0:11508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.526175:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc81f4200/0x9cc73983a7550146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a755013f expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.526194:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc81f4200/0x9cc73983a7550146 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a755013f expref: 18 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044099.526212:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1870705598712960:0@lo:104: 00000100:00100000:0.0:1784044099.526296:0:11508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044099.526425:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc81f5a00/0x9cc73983a7550138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a7550131 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.526446:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc81f5a00/0x9cc73983a7550138 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a7550131 expref: 18 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044099.526456:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff433b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1870705598713088:0@lo:104: 00000100:00100000:0.0:1784044099.526479:0:11508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044099.528762:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc81f4c00/0x9cc73983a755012a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a7550123 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.528785:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff904bc81f4c00/0x9cc73983a755012a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a7550123 expref: 18 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044099.528802:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff431500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1870705598713216:0@lo:104: 00000100:00100000:0.0:1784044099.528905:0:11508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044099.529059:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598712960 00000100:00100000:1.0:1784044099.529070:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598712960 00000100:00100000:3.0:1784044099.529233:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598713088 00000100:00100000:3.0:1784044099.529239:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598713088 00000100:00100000:3.0:1784044099.529280:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784044099.529291:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff432d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:11508:x1870705598712960:12345-0@lo:104: 00010000:00010000:3.0:1784044099.529308:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529400:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044099.529406:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff432d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+4:11508:x1870705598712960:12345-0@lo:104: Request processed in 117us (3110us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044099.529413:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784044099.529434:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784044099.529441:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:11508:x1870705598713088:12345-0@lo:104: 00010000:00010000:3.0:1784044099.529449:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529486:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784044099.529491:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:11508:x1870705598713088:12345-0@lo:104: Request processed in 51us (3011us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044099.529497:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1784044099.529524:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044099.529531:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529540:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:3.0:1784044099.529544:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529553:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044099.529561:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044099.529569:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784044099.529610:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529617:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044099.529644:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529652:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755013f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7550146 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529667:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044099.529671:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529677:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5000 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:3.0:1784044099.529680:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529686:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044099.529693:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044099.529699:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784044099.529713:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529720:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044099.529737:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529755:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a7550131 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7550138 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.529766:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044099.529767:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044099.529769:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044099.529776:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044099.529792:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598713344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044099.529824:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044099.529911:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598713472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044099.529938:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044099.530716:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784044099.530738:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598713216 00000100:00100000:1.0:1784044099.530745:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598713216 00000100:00100000:1.0:1784044099.530787:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044099.530797:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf566d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:11508:x1870705598713216:12345-0@lo:104: 00010000:00010000:1.0:1784044099.530811:0:6585:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044099.530910:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044099.530916:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf566d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+3:11508:x1870705598713216:12345-0@lo:104: Request processed in 122us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044099.530924:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784044099.531420:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598713344 00000100:00100000:2.0:1784044099.531427:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598713344 00010000:00010000:2.0:1784044099.531455:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc81f4200/0x9cc73983a7550146 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a755013f expref: 19 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044099.531488:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598713472 00000100:00100000:2.0:1784044099.531492:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598713472 00010000:00010000:2.0:1784044099.531503:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc81f5a00/0x9cc73983a7550138 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a7550131 expref: 20 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044099.531524:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784044099.531531:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3289:x1870705598713344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044099.531543:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044099.531548:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc81f4200/0x9cc73983a7550146 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a755013f expref: 20 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.531560:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc81f4200/0x9cc73983a7550146 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a755013f expref: 20 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.531584:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044099.531629:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3289:x1870705598713344:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044099.531635:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784044099.531665:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784044099.531670:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598713472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044099.531679:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044099.531684:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc81f5a00/0x9cc73983a7550138 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a7550131 expref: 19 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.531693:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc81f5a00/0x9cc73983a7550138 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a7550131 expref: 19 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.531703:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044099.531731:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598713472:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044099.531738:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1784044099.531953:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044099.531960:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.531969:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4e00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044099.531973:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.531982:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044099.531989:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044099.531995:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044099.532036:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.532062:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044099.532086:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.532093:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a7550123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a755012a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.532110:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044099.532112:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044099.532114:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044099.532344:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beee3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598713600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044099.532396:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044099.532471:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598713472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044099.532504:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598713344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044099.532550:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598713600 00000100:00100000:2.0:1784044099.532555:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598713600 00010000:00010000:2.0:1784044099.532573:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc81f4c00/0x9cc73983a755012a lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a7550123 expref: 19 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044099.532603:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784044099.532610:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598713600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044099.532620:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044099.532625:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc81f4c00/0x9cc73983a755012a lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a7550123 expref: 19 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.532634:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc81f4c00/0x9cc73983a755012a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a7550123 expref: 19 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044099.532646:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044099.532743:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598713600:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044099.532751:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1784044099.533087:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904beeee6200/0x9cc73983a755011c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead608 expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.533102:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904beeee6200/0x9cc73983a755011c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead608 expref: 12 pid: 5764 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044099.533115:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff432a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1870705598713728:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044099.533200:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904c02176000/0x9cc73983a7550115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead601 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.533209:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904c02176000/0x9cc73983a7550115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead601 expref: 12 pid: 5763 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044099.533218:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1870705598713856:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044099.533242:0:11508:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5078cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1784044099.533270:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f4200/0x9cc73983a7550146 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a755013f expref: 18 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044099.533284:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1870705598712960:0@lo:104: 00010000:00010000:0.0:1784044099.533294:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f5a00/0x9cc73983a7550138 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a7550131 expref: 17 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044099.533303:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff433b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1870705598713088:0@lo:104: 00010000:00010000:0.0:1784044099.533313:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f4c00/0x9cc73983a755012a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a7550123 expref: 16 pid: 5762 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044099.533320:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff431500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1870705598713216:0@lo:104: 00000100:00100000:1.0:1784044099.534818:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beee3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598713600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044099.538973:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff432a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1870705598713728:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044099.543493:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044099.543591:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582953472 00000100:00100000:3.0:1784044099.543592:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044099.543605:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582953472 00010000:00010000:1.0:1784044099.543680:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904beeee6200/0x9cc73983a755011c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead608 expref: 13 pid: 5764 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044099.544286:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1870705598713856:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044099.544355:0:11508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044099.545044:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582953600 00000100:00100000:2.0:1784044099.545072:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582953600 00010000:00010000:3.0:1784044099.545210:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904c02176000/0x9cc73983a7550115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead601 expref: 14 pid: 5763 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044099.545290:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:3.0:1784044099.545302:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f40c65c2-a2d0-42d6-a031-2092177c578a+14:2347:x1870705582953472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044099.545324:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044099.545331:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904beeee6200/0x9cc73983a755011c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead608 expref: 14 pid: 5764 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545363:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904beeee6200/0x9cc73983a755011c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead608 expref: 14 pid: 5764 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545387:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beeee6200/0x9cc73983a755011c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead608 expref: 14 pid: 5764 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545407:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044099.545487:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582953472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 188us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044099.545496:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:3.0:1784044099.545516:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:3.0:1784044099.545523:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f40c65c2-a2d0-42d6-a031-2092177c578a+12:2347:x1870705582953600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044099.545532:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044099.545536:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904c02176000/0x9cc73983a7550115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead601 expref: 12 pid: 5763 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545545:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904c02176000/0x9cc73983a7550115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead601 expref: 12 pid: 5763 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545556:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904c02176000/0x9cc73983a7550115 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead601 expref: 12 pid: 5763 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545569:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545579:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545605:0:5757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545612:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545619:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545626:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545633:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044099.545638:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.545647:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.546258:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044099.546274:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044099.546315:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f40c65c2-a2d0-42d6-a031-2092177c578a+11:2347:x1870705582953600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 789us (2722us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044099.546324:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00010000:00010000:0.0:1784044099.547785:0:11508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.547805:0:11508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044099.547812:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beeee6c00/0x9cc73983a755027a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044100.446696:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784044101.150029:0:5766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044101.150037:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bffcb1000 from 7 10000000:01000000:1.0:1784044101.150042:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044101.150091:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.150103:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.150115:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044101.150144:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598713984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044101.150211:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044101.150296:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be05bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044101.150559:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598713984 00000100:00100000:3.0:1784044101.150567:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598713984 00000100:00100000:3.0:1784044101.150627:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1784044101.150651:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:5766:x1870705598713984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044101.150665:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044101.150679:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9b800/0x9cc73983a7550288 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7550281 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044101.150704:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9b800/0x9cc73983a7550288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7550281 expref: 17 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044101.150714:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9b800/0x9cc73983a7550288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7550281 expref: 17 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044101.150722:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b800, rc 0) 00000100:00100000:3.0:1784044101.150814:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598713984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044101.150821:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1784044101.154268:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598713984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044101.154298:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.154312:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044101.156610:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598714112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044101.157131:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044101.157235:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be05bf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044101.164016:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598714112 00000100:00100000:2.0:1784044101.164032:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598714112 00000100:00100000:2.0:1784044101.164178:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1784044101.164190:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598714112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044101.164555:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598714112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (7423us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044101.164564:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784044101.164670:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598714112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044101.164729:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598714240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044101.164774:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044101.169930:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be05bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044101.171010:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598714240 00000100:00100000:3.0:1784044101.171020:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598714240 00000100:00100000:3.0:1784044101.171068:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1784044101.171077:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598714240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044101.171291:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598714240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (6515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044101.171299:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784044101.171405:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598714240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044101.173282:0:11521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11521:1870705598714368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044101.173376:0:11521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044101.173421:0:11521:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be05bfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044101.175611:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598714368 00000100:00100000:3.0:1784044101.175635:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598714368 00000100:00100000:3.0:1784044101.175706:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784044101.175717:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:11521:x1870705598714368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044101.176025:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:11521:x1870705598714368:12345-0@lo:502:llog_process_th.0 Request processed in 310us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044101.176039:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784044101.176362:0:11521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11521:1870705598714368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044101.176397:0:11521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044101.176406:0:11521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044101.176408:0:11521:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784044101.176415:0:11521:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff904bffcb1000 00000020:00000080:1.0:1784044101.176418:0:11521:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784044101.176542:0:11521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11521:1870705598714496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044101.176595:0:11521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044101.176739:0:11521:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc9b8e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044101.177047:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598714496 00000100:00100000:2.0:1784044101.177053:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598714496 00000100:00100000:2.0:1784044101.177086:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1784044101.177094:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:11521:x1870705598714496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044101.177266:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:11521:x1870705598714496:12345-0@lo:502:llog_process_th.0 Request processed in 172us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044101.177274:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1784044101.177508:0:11521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11521:1870705598714496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044101.177729:0:11521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044101.177736:0:11521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044101.177738:0:11521:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1784044101.177743:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1784044101.179331:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1784044101.179361:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044101.179374:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044101.179386:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044101.179396:0:5766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044101.179399:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904beee0a000 from 7 10000000:01000000:2.0:1784044101.179402:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044101.179448:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044101.179473:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044101.179486:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044101.179511:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beee38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598714624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044101.179771:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044101.179819:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd053e540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044101.180329:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598714624 00000100:00100000:1.0:1784044101.180337:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598714624 00000100:00100000:1.0:1784044101.180380:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784044101.180390:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:5766:x1870705598714624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044101.180415:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044101.180429:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1679200/0x9cc73983a7550296 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755028f expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.180516:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1679200/0x9cc73983a7550296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755028f expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.180728:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1679200/0x9cc73983a7550296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755028f expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.180738:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1679200, rc 0) 00000100:00100000:1.0:1784044101.180792:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598714624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 403us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044101.180799:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1784044101.182234:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beee38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598714624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044101.182257:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044101.182268:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044101.182337:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beee38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598714752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044101.182385:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044101.182420:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd053e540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044101.182705:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598714752 00000100:00100000:0.0:1784044101.182711:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598714752 00000100:00100000:0.0:1784044101.182753:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1784044101.182762:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598714752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044101.184144:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beee38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598714752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044101.184191:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beee38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598714880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044101.184236:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044101.184267:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd053e540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044101.184356:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598714880 00000100:00100000:1.0:1784044101.184363:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598714880 00000100:00100000:1.0:1784044101.184397:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784044101.184405:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598714880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044101.185160:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598714880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 751us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044101.185169:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1784044101.185817:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598714752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1144us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044101.185827:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1784044101.186445:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beee38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598714880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044101.189395:0:11522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11522:1870705598715008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044101.189487:0:11522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044101.189535:0:11522:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5078000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044101.190029:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598715008 00000100:00100000:1.0:1784044101.190038:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598715008 00000100:00100000:1.0:1784044101.190086:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1784044101.190095:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:11522:x1870705598715008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044101.190306:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:11522:x1870705598715008:12345-0@lo:502:llog_process_th.0 Request processed in 211us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044101.190322:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784044101.192255:0:11522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11522:1870705598715008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784044101.192306:0:11522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044101.192318:0:11522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044101.192321:0:11522:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784044101.192329:0:11522:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff904beee0a000 00000020:00000080:0.0:1784044101.192332:0:11522:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784044101.192420:0:11522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11522:1870705598715136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044101.192483:0:11522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044101.192521:0:11522:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be1909a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044101.192602:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598715136 00000100:00100000:1.0:1784044101.192609:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598715136 00000100:00100000:1.0:1784044101.192660:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784044101.192669:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:11522:x1870705598715136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044101.192900:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:11522:x1870705598715136:12345-0@lo:502:llog_process_th.0 Request processed in 231us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044101.192918:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784044101.193129:0:11522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11522:1870705598715136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784044101.193150:0:11522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044101.193155:0:11522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044101.193156:0:11522:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784044101.193161:0:11522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1784044101.194517:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1784044101.194548:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044101.194558:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.194571:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044101.194581:0:5766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044101.194583:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bc9af1000 from 7 10000000:01000000:1.0:1784044101.194586:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044101.194621:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.194629:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.194640:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044101.194662:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598715264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044101.194718:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044101.194754:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc564e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044101.194793:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598715264 00000100:00100000:0.0:1784044101.194798:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598715264 00000100:00100000:0.0:1784044101.194836:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784044101.194843:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:5766:x1870705598715264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044101.194888:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044101.194900:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee6c00/0x9cc73983a75502a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755029d expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044101.194937:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee6c00/0x9cc73983a75502a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755029d expref: 19 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044101.194947:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee6c00/0x9cc73983a75502a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755029d expref: 19 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044101.194955:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6c00, rc 0) 00000100:00100000:0.0:1784044101.194989:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598715264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044101.194995:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1784044101.195297:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598715264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044101.195312:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044101.195320:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044101.195374:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598715392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044101.195400:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044101.195427:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc80f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044101.195736:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598715392 00000100:00100000:0.0:1784044101.195741:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598715392 00000100:00100000:0.0:1784044101.195775:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784044101.195782:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598715392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044101.196185:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598715392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044101.196193:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1784044101.196287:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598715392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044101.196323:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598715520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044101.196362:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044101.196389:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc80f0480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044101.196430:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598715520 00000100:00100000:1.0:1784044101.196434:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598715520 00000100:00100000:1.0:1784044101.196474:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1784044101.196481:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598715520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044101.196806:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:5766:x1870705598715520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 325us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044101.196814:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1784044101.196966:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:5766:1870705598715520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044101.198094:0:11524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11524:1870705598715648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044101.198149:0:11524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044101.198178:0:11524:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff56ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044101.199264:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598715648 00000100:00100000:1.0:1784044101.199508:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598715648 00000100:00100000:1.0:1784044101.199702:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1784044101.199712:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:11524:x1870705598715648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044101.201134:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:11524:x1870705598715648:12345-0@lo:502:llog_process_th.0 Request processed in 1419us (2979us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044101.201146:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784044101.201306:0:11524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11524:1870705598715648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784044101.201345:0:11524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044101.201354:0:11524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044101.201356:0:11524:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784044101.201366:0:11524:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff904bc9af1000 00000020:00000080:0.0:1784044101.201369:0:11524:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784044101.202016:0:11524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11524:1870705598715776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044101.202072:0:11524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044101.202110:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598715776 00000100:00100000:0.0:1784044101.202122:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598715776 00000100:00100000:0.0:1784044101.202164:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784044101.202172:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:11524:x1870705598715776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044101.203028:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:11524:x1870705598715776:12345-0@lo:502:llog_process_th.0 Request processed in 855us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044101.203038:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784044101.203091:0:11524:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf58ad6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044101.203115:0:11524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:11524:1870705598715776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784044101.203143:0:11524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044101.203148:0:11524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044101.203150:0:11524:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784044101.203156:0:11524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1784044101.203503:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1784044101.203589:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044101.203600:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.203688:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044101.218641:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784044101.371449:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044101.371546:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582953728 00000100:00100000:1.0:1784044101.371555:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582953728 00000100:00100000:1.0:1784044101.371617:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 264 00000100:00100000:1.0:1784044101.371627:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+11:5567:x1870705582953728:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044101.371644:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044101.371662:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1678c00/0x9cc73983a75502ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead655 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.371689:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1678c00/0x9cc73983a75502ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead655 expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.371699:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1678c00/0x9cc73983a75502ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead655 expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.371707:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1678c00, rc 0) 00000100:00100000:1.0:1784044101.371767:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582953728:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 142us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044101.371773:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 264 00000100:00100000:3.0:1784044101.374320:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044101.374413:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582953856 00000100:00100000:0.0:1784044101.374422:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582953856 00000100:00100000:0.0:1784044101.374475:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 265 00000100:00100000:0.0:1784044101.374486:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582953856:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044101.374792:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582953856:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 307us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044101.374801:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 265 00000100:00100000:0.0:1784044101.380096:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044101.380198:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582953984 00000100:00100000:3.0:1784044101.380209:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582953984 00000100:00100000:3.0:1784044101.380358:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 266 00000100:00100000:3.0:1784044101.380370:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582953984:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044101.380754:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582953984:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 385us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044101.380773:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 266 00000100:00100000:3.0:1784044101.391908:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044101.392238:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582954112 00000100:00100000:1.0:1784044101.392250:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582954112 00000100:00100000:1.0:1784044101.392362:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 267 00000100:00100000:1.0:1784044101.392374:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+12:9924:x1870705582954112:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044101.392640:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+12:9924:x1870705582954112:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 266us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044101.392648:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 267 00000100:00100000:1.0:1784044101.400314:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044101.400416:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582954240 00000100:00100000:3.0:1784044101.400426:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582954240 00000100:00100000:3.0:1784044101.400478:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 268 00000100:00100000:3.0:1784044101.400488:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+12:9924:x1870705582954240:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784044101.400821:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+12:9924:x1870705582954240:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 333us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044101.400830:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 268 00000100:00100000:3.0:1784044101.413593:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044101.419131:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582954368 00000100:00100000:1.0:1784044101.419146:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582954368 00000100:00100000:1.0:1784044101.419266:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 269 00000100:00100000:1.0:1784044101.419277:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+12:5567:x1870705582954368:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044101.419295:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044101.419313:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904c02176000/0x9cc73983a75502b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead65c expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.419341:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904c02176000/0x9cc73983a75502b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead65c expref: 13 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.419352:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904c02176000/0x9cc73983a75502b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead65c expref: 13 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044101.419362:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904c02176000, rc 0) 00000100:00100000:1.0:1784044101.419436:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:5567:x1870705582954368:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 161us (5853us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044101.419444:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 269 00000100:00100000:2.0:1784044101.423351:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044101.423475:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582954496 00000100:00100000:0.0:1784044101.423485:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582954496 00000100:00100000:0.0:1784044101.423681:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 270 00000100:00100000:0.0:1784044101.423693:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:5567:x1870705582954496:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044101.424047:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:5567:x1870705582954496:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 355us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044101.424064:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 270 00000100:00100000:2.0:1784044101.426982:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044101.430833:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582954624 00000100:00100000:3.0:1784044101.430856:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582954624 00000100:00100000:3.0:1784044101.431215:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 271 00000100:00100000:3.0:1784044101.431226:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:5567:x1870705582954624:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044101.431457:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:5567:x1870705582954624:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 231us (4484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044101.431465:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 271 00000100:00100000:3.0:1784044101.435323:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044101.435428:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582954752 00000100:00100000:0.0:1784044101.435436:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582954752 00000100:00100000:0.0:1784044101.435494:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 272 00000100:00100000:0.0:1784044101.435505:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:9927:x1870705582954752:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044101.435929:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:9927:x1870705582954752:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 424us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044101.435938:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 272 00000100:00100000:2.0:1784044101.444660:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044101.445102:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582954880 00000100:00100000:0.0:1784044101.445112:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582954880 00000100:00100000:0.0:1784044101.445172:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 273 00000100:00100000:0.0:1784044101.445182:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:9927:x1870705582954880:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044101.445593:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:9927:x1870705582954880:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 411us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044101.445602:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 273 00010000:00010000:2.0:1784044101.470167:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044102.238755:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044102.496997:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044102.558211:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044102.558240:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598715904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044102.558310:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044102.558392:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598716032:0@lo:400:kworker.0 00000100:00100000:2.0:1784044102.558432:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044102.558464:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598716544:0@lo:400:kworker.0 00000100:00100000:0.0:1784044102.558471:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598716032 00000100:00100000:0.0:1784044102.558480:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598716032 00000100:00100000:2.0:1784044102.558491:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044102.558513:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044102.558520:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598716416:0@lo:400:kworker.0 00000100:00100000:0.0:1784044102.558531:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1784044102.558542:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598716032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044102.558550:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044102.558583:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598716416 00000100:00100000:2.0:1784044102.558587:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598716416 00000100:00100000:0.0:1784044102.558609:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598716032:12345-0@lo:400:kworker.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044102.558618:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1784044102.558633:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784044102.558642:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598716416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044102.558685:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598716416:12345-0@lo:400:kworker.0 Request processed in 45us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044102.558689:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598716032:0@lo:400:kworker.0 00000100:00100000:2.0:1784044102.558696:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1784044102.558718:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044102.558723:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598716416:0@lo:400:kworker.0 00000100:00100000:1.0:1784044102.558814:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598716288:0@lo:400:kworker.0 00000100:00100000:1.0:1784044102.558857:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044102.558904:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598715904 00000100:00100000:3.0:1784044102.558910:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598715904 00000100:00100000:1.0:1784044102.558921:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044102.558929:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598716160:0@lo:400:kworker.0 00000100:00100000:3.0:1784044102.558955:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044102.558959:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044102.558968:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598715904:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044102.558991:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598716288 00000100:00100000:1.0:1784044102.558995:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598716288 00002000:00000024:3.0:1784044102.559000:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044102.559025:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598716160 00000100:00100000:1.0:1784044102.559036:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598716160 00000100:00100000:3.0:1784044102.559046:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598715904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044102.559061:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784044102.559065:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044102.559073:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598716288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044102.559096:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598716544 00000100:00100000:1.0:1784044102.559113:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598716288:12345-0@lo:400:kworker.0 Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044102.559120:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784044102.559133:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784044102.559140:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598716160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044102.559166:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598716160:12345-0@lo:400:kworker.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044102.559172:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784044102.559214:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598716160:0@lo:400:kworker.0 00000100:00100000:1.0:1784044102.559222:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598716288:0@lo:400:kworker.0 00000100:00100000:3.0:1784044102.559269:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598716544 00000100:00100000:3.0:1784044102.559312:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784044102.559320:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598716544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044102.559355:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598716544:12345-0@lo:400:kworker.0 Request processed in 37us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044102.559361:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1784044102.559480:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044102.559483:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044102.559485:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784044102.559509:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff430a80 x1870705598716544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044102.559522:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598716544:0@lo:400:kworker.0 00000100:00100000:0.0:1784044102.559531:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1784044102.559536:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904bed281180, transno 4294967300 00000100:00100000:0.0:1784044102.559561:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598715904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044103.070308:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044103.070332:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598716672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044103.070415:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.070480:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598716672 00000100:00100000:2.0:1784044103.070489:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598716672 00000100:00100000:2.0:1784044103.070543:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784044103.070553:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598716672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044103.070590:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044103.070656:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598716672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044103.070676:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1784044103.070834:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bff50c700 x1870705598716672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044103.070854:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598716672:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784044103.529159:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044103.550895:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044103.550938:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044103.550984:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044103.551005:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044103.551046:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582955264 00000100:00100000:2.0:1784044103.551055:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582955264 00000100:00100000:2.0:1784044103.551114:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:2.0:1784044103.551124:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582955264:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044103.551195:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582955264:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044103.551203:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:1.0:1784044103.551394:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582955136 00000100:00100000:1.0:1784044103.551399:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582955136 00000100:00100000:1.0:1784044103.551435:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582955392 00000100:00100000:1.0:1784044103.551439:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582955392 00000100:00100000:1.0:1784044103.551530:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:1.0:1784044103.551537:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582955136:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044103.551573:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582955136:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044103.551579:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:1.0:1784044103.551591:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:1.0:1784044103.551609:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582955392:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044103.551632:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582955392:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 24us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044103.551638:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:0.0:1784044103.551787:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582955008 00000100:00100000:0.0:1784044103.551792:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582955008 00000100:00100000:0.0:1784044103.551840:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 275 00000100:00100000:0.0:1784044103.551847:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705582955008:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044103.551900:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705582955008:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 53us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044103.551908:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 275 00000100:00080000:0.0:1784044103.551936:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044103.551941:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784044104.542149:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044105.566094:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044106.590197:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044107.615157:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044107.681780:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598716928:0@lo:400:kworker.0 00000100:00100000:2.0:1784044107.681781:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598717184:0@lo:400:kworker.0 00000100:00100000:0.0:1784044107.681904:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598716800:0@lo:400:kworker.0 00000100:00100000:1.0:1784044107.682046:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598717056:0@lo:400:kworker.0 00000100:00100000:2.0:1784044107.682200:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044107.682339:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598717184 00000100:00100000:2.0:1784044107.682346:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598717184 00000100:00100000:2.0:1784044107.682417:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784044107.682429:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598717184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044107.682500:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598717184:12345-0@lo:400:kworker.0 Request processed in 73us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044107.682508:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784044107.682551:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598717184:0@lo:400:kworker.0 00000100:00080000:2.0:1784044107.682595:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044107.684818:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044107.684944:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598717056 00000100:00100000:2.0:1784044107.684958:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598717056 00000100:00100000:2.0:1784044107.685040:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784044107.685054:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598717056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044107.692753:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044107.692852:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598717312:0@lo:400:kworker.0 00000100:00100000:0.0:1784044107.693008:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598716800 00000100:00100000:0.0:1784044107.693018:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598716800 00000100:00100000:0.0:1784044107.693088:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784044107.693100:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598716800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044107.693164:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598717568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044107.693170:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598716800:12345-0@lo:400:kworker.0 Request processed in 73us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044107.693179:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1784044107.693197:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044107.693222:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044107.693237:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598717312 00000100:00100000:1.0:1784044107.693241:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598717312 00000100:00100000:0.0:1784044107.693278:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598716800:0@lo:400:kworker.0 00000100:00100000:1.0:1784044107.693280:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784044107.693286:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598717312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044107.693329:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598717312:12345-0@lo:400:kworker.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044107.693332:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598717568 00000100:00100000:1.0:1784044107.693335:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784044107.693336:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598717568 00000100:00100000:0.0:1784044107.693362:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784044107.693369:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598717568:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044107.693374:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598717312:0@lo:400:kworker.0 00002000:00000024:0.0:1784044107.693406:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044107.693451:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598717568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044107.693457:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784044107.693489:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598717568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784044107.694806:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044107.698964:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598717056:12345-0@lo:400:kworker.0 Request processed in 13897us (14138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044107.698983:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784044107.700970:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044107.701051:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598717440:0@lo:400:kworker.0 00000100:00100000:3.0:1784044107.701123:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044107.701184:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598716928 00000100:00100000:1.0:1784044107.701194:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598716928 00000100:00100000:1.0:1784044107.701273:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784044107.701283:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598716928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044107.701354:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598716928:12345-0@lo:400:kworker.0 Request processed in 72us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044107.701361:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784044107.701438:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598717440 00000100:00100000:2.0:1784044107.701442:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598717440 00000100:00100000:2.0:1784044107.701505:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784044107.701513:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598717440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044107.701550:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598717440:12345-0@lo:400:kworker.0 Request processed in 38us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044107.701556:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1784044107.701668:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044107.701761:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598716928:0@lo:400:kworker.0 00010000:00080000:3.0:1784044107.701778:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bd0230700 x1870705598717440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044107.701790:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598717440:0@lo:400:kworker.0 00000100:00100000:0.0:1784044107.702927:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598717056:0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.191803:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598717696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044108.191934:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044108.192237:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598717696 00000100:00100000:1.0:1784044108.192267:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598717696 00000100:00100000:1.0:1784044108.192350:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784044108.192362:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598717696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044108.192410:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044108.192472:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598717696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044108.192480:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1784044108.192640:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3bb480 x1870705598717696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044108.192678:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598717696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784044108.638235:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044108.667343:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044108.667388:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044108.667441:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044108.667484:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582955648 00000100:00100000:2.0:1784044108.667493:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044108.667497:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582955648 00000100:00100000:2.0:1784044108.667541:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582955776 00000100:00100000:2.0:1784044108.667546:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582955776 00000100:00100000:3.0:1784044108.667577:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582955904 00000100:00100000:3.0:1784044108.667582:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582955904 00000100:00100000:2.0:1784044108.667597:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:2.0:1784044108.667612:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2348:x1870705582955776:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044108.667617:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:3.0:1784044108.667627:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2348:x1870705582955648:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044108.667766:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582955520 00000100:00100000:0.0:1784044108.667771:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582955520 00000100:00100000:0.0:1784044108.667817:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 277 00000100:00100000:0.0:1784044108.667826:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2348:x1870705582955520:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044108.667942:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2348:x1870705582955776:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 334us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044108.667952:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:1.0:1784044108.668142:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 107 00000100:00100000:1.0:1784044108.668154:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2348:x1870705582955904:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044108.670140:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2348:x1870705582955648:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2493us (2792us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044108.670159:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00080000:3.0:1784044108.670350:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044108.670358:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044108.670737:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2348:x1870705582955520:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2906us (3289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044108.670831:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 277 00000100:00100000:1.0:1784044108.673441:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2348:x1870705582955904:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 5271us (6033us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044108.673462:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 107 00010000:00010000:2.0:1784044109.662134:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044110.686505:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044111.713533:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044112.478939:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044112.734610:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044112.798193:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598717824:0@lo:400:kworker.0 00000100:00100000:3.0:1784044112.798209:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598718208:0@lo:400:kworker.0 00000100:00100000:0.0:1784044112.798324:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598718080:0@lo:400:kworker.0 00000100:00100000:2.0:1784044112.798519:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598717952:0@lo:400:kworker.0 00000100:00100000:3.0:1784044112.800176:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044112.800593:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044112.800605:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044112.800621:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044112.800900:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598717824 00000100:00100000:1.0:1784044112.800915:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598717824 00000100:00100000:1.0:1784044112.800983:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784044112.800999:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598717824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044112.801040:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598718592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044112.801104:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044112.801114:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598717824:12345-0@lo:400:kworker.0 Request processed in 117us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044112.801125:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1784044112.801175:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598718592 00000100:00100000:0.0:1784044112.801186:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598718592 00000100:00100000:1.0:1784044112.801213:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598717824:0@lo:400:kworker.0 00000100:00100000:0.0:1784044112.801270:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044112.801282:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598718208 00000100:00100000:0.0:1784044112.801290:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598718592:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044112.801291:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598718208 00002000:00000024:0.0:1784044112.801344:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044112.801347:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598718336:0@lo:400:kworker.0 00000100:00100000:1.0:1784044112.801372:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784044112.801385:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598718208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044112.801402:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044112.801412:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598718592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044112.801421:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044112.801463:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598718208:12345-0@lo:400:kworker.0 Request processed in 79us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044112.801478:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598718208:0@lo:400:kworker.0 00000100:00100000:1.0:1784044112.801479:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784044112.801545:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598718080 00000100:00100000:3.0:1784044112.801550:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598718080 00000100:00100000:3.0:1784044112.801595:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598718336 00000100:00100000:3.0:1784044112.801598:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598718336 00000100:00100000:3.0:1784044112.801621:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784044112.801638:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598718080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044112.801944:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598718080:12345-0@lo:400:kworker.0 Request processed in 315us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044112.801952:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784044112.801966:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784044112.801973:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598718336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044112.802005:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598718336:12345-0@lo:400:kworker.0 Request processed in 33us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044112.802438:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784044112.802485:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598718336:0@lo:400:kworker.0 00000100:00080000:3.0:1784044112.802519:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044112.802524:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044112.803625:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044112.803820:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598718080:0@lo:400:kworker.0 00000100:00100000:1.0:1784044112.803934:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598718592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044112.804605:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598718464:0@lo:400:kworker.0 00000100:00100000:2.0:1784044112.804681:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044112.806667:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598718464 00000100:00100000:0.0:1784044112.806684:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598718464 00000100:00100000:0.0:1784044112.806790:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784044112.806803:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598718464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044112.806917:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598718464:12345-0@lo:400:kworker.0 Request processed in 116us (2235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044112.806925:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1784044112.807061:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784044112.807229:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904beeef2a00 x1870705598718464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044112.807244:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598718464:0@lo:400:kworker.0 00000100:00100000:3.0:1784044112.810020:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598717952 00000100:00100000:3.0:1784044112.810034:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598717952 00000100:00100000:3.0:1784044112.810111:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784044112.810122:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598717952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044112.810237:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598717952:12345-0@lo:400:kworker.0 Request processed in 117us (6615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044112.810245:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784044112.810472:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598717952:0@lo:400:kworker.0 00000100:00100000:0.0:1784044113.310349:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044113.317272:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598718720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044113.317817:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044113.317897:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598718720 00000100:00100000:2.0:1784044113.317907:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598718720 00000100:00100000:2.0:1784044113.317956:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784044113.317967:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598718720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044113.318008:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044113.318077:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598718720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044113.318094:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1784044113.318485:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3b8a80 x1870705598718720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044113.318526:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598718720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784044113.758661:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044113.798832:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044113.798925:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044113.799027:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582956160 00000100:00100000:3.0:1784044113.799038:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582956160 00000100:00100000:3.0:1784044113.799106:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 111 00000100:00100000:3.0:1784044113.799118:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582956160:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044113.799207:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705582956160:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 91us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044113.799216:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 111 00000100:00080000:1.0:1784044113.799899:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044113.801551:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582956032 00000100:00100000:0.0:1784044113.801567:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582956032 00000100:00100000:0.0:1784044113.801653:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 279 00000100:00100000:0.0:1784044113.801663:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582956032:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044113.801746:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582956032:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 84us (2923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044113.801753:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 279 00000100:00100000:2.0:1784044113.819254:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044113.819581:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582956416 00000100:00100000:3.0:1784044113.819592:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582956416 00000100:00100000:3.0:1784044113.819691:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 112 00000100:00100000:3.0:1784044113.819702:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582956416:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044113.819795:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582956416:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 95us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044113.819803:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 112 00000100:00080000:1.0:1784044113.820599:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044113.827363:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044113.827896:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582956288 00000100:00100000:2.0:1784044113.827907:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582956288 00000100:00100000:2.0:1784044113.827988:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1784044113.827999:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2344:x1870705582956288:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:2.0:1784044113.828028:0:6571:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a75501ee 00000100:00080000:2.0:1784044113.828038:0:6571:0:(import.c:65:import_set_state_nolock()) ffff904bed244000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044113.828080:0:6571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1784044113.829730:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784044113.832041:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044113.832936:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+2:2344:x1870705582956288:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 2233us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044113.832963:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00010000:00010000:2.0:1784044114.782070:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044115.806176:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044116.830936:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044117.854174:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044117.918576:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598719232:0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.918654:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044117.918720:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784044117.918726:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598718848:0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.918761:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044117.918781:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598719360:0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.918801:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044117.918823:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598718976:0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.918842:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044117.918856:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598719488:0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.918923:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044117.918940:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044117.918945:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598719104:0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.918964:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044117.919010:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598719360 00000100:00100000:2.0:1784044117.919018:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598719360 00000100:00100000:2.0:1784044117.919075:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598718976 00000100:00100000:2.0:1784044117.919078:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598718976 00000100:00100000:2.0:1784044117.919088:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598719104 00000100:00100000:2.0:1784044117.919090:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598719104 00000100:00100000:2.0:1784044117.919103:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784044117.919111:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598719360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.919672:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598719360:12345-0@lo:400:kworker.0 Request processed in 559us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044117.919681:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784044117.919703:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784044117.919711:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598718976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.919741:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598718976:12345-0@lo:400:kworker.0 Request processed in 33us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044117.919758:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784044117.919768:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784044117.919774:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598719104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.919798:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598719104:12345-0@lo:400:kworker.0 Request processed in 25us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044117.919803:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784044117.919828:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598719232 00000100:00100000:2.0:1784044117.919832:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598719232 00000100:00100000:2.0:1784044117.919857:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598719488 00000100:00100000:2.0:1784044117.919860:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598719488 00000100:00100000:2.0:1784044117.919906:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784044117.919912:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598719232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.919939:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598719232:12345-0@lo:400:kworker.0 Request processed in 27us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044117.919953:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784044117.919963:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784044117.919968:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598719488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.919996:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598719488:12345-0@lo:400:kworker.0 Request processed in 28us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044117.920002:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1784044117.920016:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044117.920020:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044117.920022:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044117.920233:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598719360:0@lo:400:kworker.0 00000100:00100000:1.0:1784044117.920246:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598719232:0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.920304:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598719104:0@lo:400:kworker.0 00000100:00100000:2.0:1784044117.920320:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598718976:0@lo:400:kworker.0 00010000:00080000:2.0:1784044117.920332:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc4cfdc00 x1870705598719488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044117.920341:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598719488:0@lo:400:kworker.0 00000100:00100000:1.0:1784044117.920584:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044117.920595:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598719616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044117.920633:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044117.920713:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598719616 00000100:00100000:0.0:1784044117.920719:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598719616 00000100:00100000:0.0:1784044117.920766:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784044117.920774:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598719616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044117.920806:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044117.920845:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598719616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044117.920852:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784044117.920899:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598719616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044117.921024:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598718848 00000100:00100000:3.0:1784044117.921029:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598718848 00000100:00100000:3.0:1784044117.921072:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1784044117.921079:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598718848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044117.921121:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598718848:12345-0@lo:400:kworker.0 Request processed in 43us (2359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044117.921128:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1784044117.921171:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598718848:0@lo:400:kworker.0 00000100:00100000:2.0:1784044118.430546:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598719744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044118.430624:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044118.430815:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598719744 00000100:00100000:1.0:1784044118.430824:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598719744 00000100:00100000:1.0:1784044118.430903:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784044118.430922:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598719744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044118.430958:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044118.431010:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598719744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044118.431017:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1784044118.431107:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3b9c00 x1870705598719744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044118.431129:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598719744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784044118.881828:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044118.907108:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044118.907152:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044118.907188:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044118.907291:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582956672 00000100:00100000:2.0:1784044118.907302:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582956672 00000100:00100000:2.0:1784044118.907369:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582956800 00000100:00100000:2.0:1784044118.907373:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582956800 00000100:00100000:2.0:1784044118.907394:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1784044118.907404:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582956672:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044118.907483:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582956672:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 80us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044118.907524:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1784044118.907543:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:2.0:1784044118.907549:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582956800:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044118.907591:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582956800:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044118.907597:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:1.0:1784044118.908163:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582956544 00000100:00100000:1.0:1784044118.908169:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582956544 00000100:00100000:1.0:1784044118.908212:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 281 00000100:00100000:1.0:1784044118.908221:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582956544:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044118.908264:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582956544:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 45us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044118.908272:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 281 00000100:00080000:0.0:1784044118.910655:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1784044118.965810:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:2.0:1784044118.965821:0:6598:0:(genops.c:906:class_export_put()) final put ffff904bed245000/3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:1.0:1784044118.965892:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bed245000/3609c122-577c-43fa-ab52-dd2c7dc5cce7 for lustre-OST0000 00000020:00000080:1.0:1784044118.965961:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bed244000 for lustre-OST0000 00010000:00010000:0.0:1784044119.902448:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044120.927934:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044121.951107:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784044122.719116:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784044122.976471:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044123.039663:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598719872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044123.039732:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044123.041138:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598719872 00000100:00100000:1.0:1784044123.041148:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598719872 00000100:00100000:1.0:1784044123.041215:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784044123.041225:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598719872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044123.041262:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044123.041322:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598719872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044123.041329:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784044123.041378:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598719872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784044123.041559:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044123.042749:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598720000:0@lo:400:kworker.0 00000100:00100000:1.0:1784044123.042796:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044123.044772:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598720000 00000100:00100000:3.0:1784044123.044782:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598720000 00000100:00100000:3.0:1784044123.044831:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784044123.044842:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598720000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044123.045364:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598720128:0@lo:400:kworker.0 00000100:00100000:2.0:1784044123.045404:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044123.045429:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044123.045448:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598720512:0@lo:400:kworker.0 00000100:00100000:2.0:1784044123.045474:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044123.045510:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598720128 00000100:00100000:2.0:1784044123.045514:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598720128 00000100:00100000:2.0:1784044123.045546:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784044123.045553:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598720128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044123.045602:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598720128:12345-0@lo:400:kworker.0 Request processed in 37us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044123.045609:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784044123.045631:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598720512 00000100:00100000:2.0:1784044123.045635:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598720512 00000100:00100000:2.0:1784044123.045669:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784044123.045675:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598720512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044123.045705:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598720512:12345-0@lo:400:kworker.0 Request processed in 30us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044123.045720:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784044123.045743:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598720256:0@lo:400:kworker.0 00000100:00100000:2.0:1784044123.045768:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044123.045785:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044123.045790:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598720384:0@lo:400:kworker.0 00000100:00100000:2.0:1784044123.045810:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784044123.045831:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784044123.045855:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc5fc9180 x1870705598720512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044123.045891:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598720512:0@lo:400:kworker.0 00000100:00100000:2.0:1784044123.045902:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598720128:0@lo:400:kworker.0 00000100:00100000:3.0:1784044123.046757:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598720000:12345-0@lo:400:kworker.0 Request processed in 1914us (3956us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044123.046767:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1784044123.047040:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598720256 00000100:00100000:0.0:1784044123.047047:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598720256 00000100:00100000:0.0:1784044123.047091:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598720384 00000100:00100000:0.0:1784044123.047094:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598720384 00000100:00100000:0.0:1784044123.047111:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784044123.047117:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598720256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044123.047163:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598720256:12345-0@lo:400:kworker.0 Request processed in 46us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044123.047169:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784044123.047180:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784044123.047185:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598720384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044123.047206:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598720384:12345-0@lo:400:kworker.0 Request processed in 22us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044123.047211:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784044123.047240:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598720384:0@lo:400:kworker.0 00000100:00100000:0.0:1784044123.047248:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598720256:0@lo:400:kworker.0 00000100:00080000:2.0:1784044123.047753:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044123.048127:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598720000:0@lo:400:kworker.0 00000100:00100000:0.0:1784044123.550220:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044123.550243:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598720640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044123.550311:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044123.550549:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598720640 00000100:00100000:1.0:1784044123.550556:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598720640 00000100:00100000:1.0:1784044123.550607:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784044123.550634:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598720640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044123.550666:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044123.550727:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598720640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044123.550735:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1784044123.551380:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bfb3b8700 x1870705598720640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044123.551402:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598720640:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784044124.000003:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044124.028089:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044124.028139:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044124.028177:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044124.028206:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582957056 00000100:00100000:1.0:1784044124.028215:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582957056 00000100:00100000:1.0:1784044124.028265:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582957184 00000100:00100000:1.0:1784044124.028267:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582957184 00000100:00100000:1.0:1784044124.028288:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:1.0:1784044124.028297:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582957056:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044124.028374:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582957056:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044124.028382:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:1.0:1784044124.028400:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:1.0:1784044124.028407:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582957184:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044124.028444:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582957184:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 38us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.028449:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582956928 00000100:00100000:1.0:1784044124.028452:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:3.0:1784044124.028456:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582956928 00000100:00080000:1.0:1784044124.028471:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044124.028493:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 283 00000100:00100000:3.0:1784044124.028500:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705582956928:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044124.028529:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705582956928:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.028536:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 283 00000001:02000400:3.0:1784044124.751083:0:11687:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 11:48:43 (1784044123) 00010000:00010000:1.0:1784044125.022102:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044126.049463:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044126.442561:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044126.442680:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582957312 00000100:00100000:1.0:1784044126.442694:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582957312 00000100:00100000:1.0:1784044126.442824:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:1.0:1784044126.442838:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:10196:x1870705582957312:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00000100:00080000:3.0:1784044126.443135:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784044126.443170:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044126.443204:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75502b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead663 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044126.443532:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75502c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044126.443552:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75502c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044126.443570:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75502c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044126.444114:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784044126.444121:0:7482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044126.444242:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75502c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044126.444488:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a75502b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead663 expref: 7 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044126.444514:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75502c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead663 expref: 6 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044126.444525:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:1.0:1784044126.444528:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044126.444532:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904c02177400, rc 0) 00000100:00100000:1.0:1784044126.444628:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:10196:x1870705582957312:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1792us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044126.444646:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:1.0:1784044126.455638:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044126.456800:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582957440 00000100:00100000:2.0:1784044126.456818:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582957440 00000100:00100000:2.0:1784044126.457231:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:2.0:1784044126.457245:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:10197:x1870705582957440:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044126.457287:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044126.457316:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a75502c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead66a expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.457423:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a75502ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.457443:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a75502ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.457484:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a75502ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.457503:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75502d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.457512:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75502d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.457518:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75502d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.458483:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4c00/0x9cc73983a75502dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.458502:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4c00/0x9cc73983a75502dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.458511:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4c00/0x9cc73983a75502dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044126.458608:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784044126.458612:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044126.458702:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4c00/0x9cc73983a75502dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.458715:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a75502ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466231:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a75502ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466274:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a75502ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466282:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044126.466288:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a75502ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466300:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a75502ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466326:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:2.0:1784044126.466329:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044126.466335:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a75502ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466343:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a75502ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466389:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75502d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466397:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75502d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466416:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75502d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466421:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044126.466424:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75502d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466441:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75502d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466450:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff904bd19d5c00) 00010000:00010000:2.0:1784044126.466453:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044126.466456:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75502d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466462:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75502d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466548:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a75502c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead66a expref: 8 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466568:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4c00/0x9cc73983a75502dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead66a expref: 7 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044126.466576:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff904bd19d5e00) 00010000:00010000:2.0:1784044126.466579:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044126.466581:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4c00, rc 0) 00000100:00100000:2.0:1784044126.468364:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:10197:x1870705582957440:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 11105us (12724us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044126.468800:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:2.0:1784044126.471514:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044126.474519:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582957696 00000100:00100000:0.0:1784044126.474542:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582957696 00000100:00100000:0.0:1784044126.474633:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:0.0:1784044126.474645:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:10197:x1870705582957696:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044126.474674:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044126.474703:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75502e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead671 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.474833:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75502ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.474850:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75502ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.475276:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75502ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.475814:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75502f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.475840:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75502f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.475853:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75502f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.476478:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6800/0x9cc73983a75502f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.476488:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6800/0x9cc73983a75502f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.476496:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6800/0x9cc73983a75502f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044126.476508:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1784044126.476731:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75502ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.476740:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75502ea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.476753:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75502ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.476759:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044126.477709:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75502ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.477726:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75502ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.477742:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff904bd19d5e00) 00010000:00010000:0.0:1784044126.477746:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044126.477752:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75502ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.477758:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75502ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.477981:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75502f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.477987:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75502f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.477994:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75502f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.477999:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044126.478003:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75502f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.478026:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75502f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.478035:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff904bda59a600) 00010000:00010000:0.0:1784044126.478038:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044126.478040:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75502f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.478046:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75502f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.478999:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75502e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead671 expref: 10 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.479019:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6800/0x9cc73983a75502f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead671 expref: 9 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044126.479027:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:0.0:1784044126.479029:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044126.479031:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6800, rc 0) 00000100:00100000:0.0:1784044126.479238:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:10197:x1870705582957696:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 4593us (7740us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784044126.479249:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:0.0:1784044126.488967:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044126.489088:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582957824 00000100:00100000:2.0:1784044126.489100:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582957824 00000100:00100000:2.0:1784044126.489165:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:2.0:1784044126.489177:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:10197:x1870705582957824:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784044126.489335:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:10197:x1870705582957824:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 Request processed in 159us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044126.489344:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000040:00080000:1.0:1784044126.816686:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784044127.070729:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044128.081564:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044128.081703:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582957952 00000100:00100000:2.0:1784044128.081714:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582957952 00000100:00100000:2.0:1784044128.081846:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:2.0:1784044128.081858:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:10240:x1870705582957952:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1784044128.081898:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044128.081920:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead678 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.081995:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755030d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082010:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755030d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082023:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755030d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082043:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550314 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082051:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082057:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082370:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755030d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082384:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755030d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082391:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755030d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082397:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044128.082402:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755030d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082410:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755030d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082422:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:2.0:1784044128.082425:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044128.082430:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755030d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082436:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755030d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082447:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082453:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550314 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082459:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550314 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082464:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044128.082485:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550314 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082492:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550314 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082501:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff904bd19d5c00) 00010000:00010000:2.0:1784044128.082503:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044128.082506:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550314 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082512:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550314 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082556:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550306 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead678 expref: 10 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082567:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:2.0:1784044128.082569:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044128.082572:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead678 expref: 10 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.082581:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4000, rc 0) 00000100:00100000:2.0:1784044128.082664:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:10240:x1870705582957952:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 808us (1111us total) trans 0 rc 301/301 00000100:00100000:2.0:1784044128.082673:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00080000:3.0:1784044128.083714:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044128.092299:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.094709:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582958208 00000100:00100000:0.0:1784044128.094724:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582958208 00000100:00100000:0.0:1784044128.094799:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:0.0:1784044128.094810:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:10240:x1870705582958208:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:0.0:1784044128.094894:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044128.094922:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a75502c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead663 expref: 9 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.094941:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:0.0:1784044128.094958:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044128.095783:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755031b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.095799:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755031b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.095810:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755031b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.095824:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.095831:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.095838:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044128.099813:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1784044128.099833:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755031b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.099844:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755031b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.099851:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755031b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.099892:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044128.099898:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755031b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.099906:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755031b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.099923:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59af00) 00010000:00010000:0.0:1784044128.099926:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044128.099931:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755031b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.099937:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755031b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044128.099956:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007096d432 reply state 00000000d1820946 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044128.099965:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044128.100081:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:10240:x1870705582958208:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 5268us (7786us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784044128.100093:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00010000:00010000:3.0:1784044128.100947:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044128.104245:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.104262:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.104270:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.104277:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044128.104282:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.104289:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.104305:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff904bda59a200) 00010000:00010000:1.0:1784044128.104308:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044128.104312:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.104318:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550322 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044128.159294:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598721152:0@lo:400:kworker.0 00000100:00100000:2.0:1784044128.159376:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044128.159435:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044128.159456:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598721024:0@lo:400:kworker.0 00000100:00100000:2.0:1784044128.159485:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044128.160807:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598720768:0@lo:400:kworker.0 00000100:00100000:0.0:1784044128.160861:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044128.160912:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598721280:0@lo:400:kworker.0 00000100:00100000:0.0:1784044128.160937:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044128.160962:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784044128.160969:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598720896:0@lo:400:kworker.0 00000100:00100000:0.0:1784044128.161004:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044128.161024:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598721408:0@lo:400:kworker.0 00000100:00100000:0.0:1784044128.161047:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044128.161272:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598721024 00000100:00100000:1.0:1784044128.161287:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598721024 00000100:00100000:1.0:1784044128.161412:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598721280 00000100:00100000:1.0:1784044128.161416:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598721280 00000100:00100000:1.0:1784044128.161432:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598720896 00000100:00100000:1.0:1784044128.161435:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598720896 00000100:00100000:1.0:1784044128.161451:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1784044128.161460:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598721024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044128.161530:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598721024:12345-0@lo:400:kworker.0 Request processed in 70us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.161538:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1784044128.161555:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1784044128.161561:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598721280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044128.161589:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598721280:12345-0@lo:400:kworker.0 Request processed in 29us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.161594:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1784044128.161604:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1784044128.161609:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598720896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044128.161634:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598720896:12345-0@lo:400:kworker.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.161640:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1784044128.161661:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044128.161695:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598721024:0@lo:400:kworker.0 00000100:00100000:0.0:1784044128.162565:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598721280:0@lo:400:kworker.0 00000100:00100000:0.0:1784044128.162586:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598720896:0@lo:400:kworker.0 00000100:00100000:0.0:1784044128.162612:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598721152 00000100:00100000:0.0:1784044128.162616:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598721152 00000100:00100000:0.0:1784044128.162660:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598721408 00000100:00100000:0.0:1784044128.162663:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598721408 00000100:00100000:0.0:1784044128.162686:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784044128.162694:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598721152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044128.162739:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598721152:12345-0@lo:400:kworker.0 Request processed in 46us (3363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044128.162746:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784044128.162758:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784044128.162764:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598721408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044128.162792:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598721408:12345-0@lo:400:kworker.0 Request processed in 29us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044128.162797:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1784044128.162972:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc5fcad80 x1870705598721408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044128.162984:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598721408:0@lo:400:kworker.0 00000100:00080000:1.0:1784044128.163936:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044128.163944:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044128.163979:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598721152:0@lo:400:kworker.0 00000100:00100000:1.0:1784044128.165059:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044128.165110:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598720768 00000100:00100000:3.0:1784044128.165118:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598720768 00000100:00100000:3.0:1784044128.165175:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1784044128.165185:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598720768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044128.165266:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598720768:12345-0@lo:400:kworker.0 Request processed in 83us (4404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044128.165274:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1784044128.165325:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598720768:0@lo:400:kworker.0 00000100:00100000:3.0:1784044128.173516:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc4cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598721536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044128.173596:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044128.173787:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598721536 00000100:00100000:1.0:1784044128.173800:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598721536 00000100:00100000:1.0:1784044128.173855:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784044128.173893:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598721536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044128.173931:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044128.173980:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598721536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.173989:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784044128.174034:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc4cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598721536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044128.230834:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044128.231330:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582958336 00000100:00100000:1.0:1784044128.231351:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582958336 00000100:00100000:1.0:1784044128.231424:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:1.0:1784044128.231434:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:10248:x1870705582958336:12345-192.168.204.50@tcp:101:lctl.0 00010000:00010000:1.0:1784044128.231464:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044128.231487:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550329 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead67f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.231555:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550330 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.231570:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.231582:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044128.231642:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784044128.231645:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044128.231683:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.231726:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead67f expref: 11 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.231743:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550330 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead67f expref: 10 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.231751:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:1.0:1784044128.231754:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044128.231757:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904c02177400, rc 0) 00000100:00100000:1.0:1784044128.231817:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:10248:x1870705582958336:12345-192.168.204.50@tcp:101:lctl.0 Request processed in 384us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.231823:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:3.0:1784044128.291959:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044128.292118:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582958464 00000100:00100000:1.0:1784044128.292130:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582958464 00000100:00100000:1.0:1784044128.292203:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:1.0:1784044128.292214:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:10254:x1870705582958464:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1784044128.292239:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044128.292261:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead686 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292358:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755033e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292374:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755033e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292387:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755033e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292426:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550345 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292434:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292441:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292566:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755034c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292575:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755034c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292583:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755034c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044128.292617:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1784044128.292621:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044128.292661:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755034c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292674:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755033e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292679:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755033e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292685:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755033e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292701:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044128.292706:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755033e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292712:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755033e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292724:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:1.0:1784044128.292727:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044128.292732:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755033e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292737:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755033e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292753:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292759:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292764:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292770:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044128.292772:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292779:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550345 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292797:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff904bc5fdb200) 00010000:00010000:1.0:1784044128.292800:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044128.292803:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550345 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292809:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550345 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292843:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a7550337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead686 expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292859:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755034c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead686 expref: 11 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.292924:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044128.292927:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784044128.292929:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663200, rc 0) 00000100:00100000:1.0:1784044128.292993:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+11:10254:x1870705582958464:12345-192.168.204.50@tcp:101:bash.0 Request processed in 782us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.293000:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:3.0:1784044128.298661:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044128.299134:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582958720 00000100:00100000:1.0:1784044128.299145:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582958720 00000100:00100000:1.0:1784044128.299218:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:1.0:1784044128.299228:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+11:10254:x1870705582958720:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1784044128.299249:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044128.299271:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550353 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead68d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.299460:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755035a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.299476:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755035a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.299489:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755035a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.299552:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.299560:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.299566:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044128.300904:0:5770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1784044128.301210:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301225:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301236:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301271:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755035a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301295:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755035a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301302:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755035a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301310:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044128.301315:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755035a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301322:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755035a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301348:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044128.301352:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044128.301357:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755035a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301365:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755035a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044128.301382:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2868b5e reply state 000000005385d275 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044128.301402:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784044128.301442:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550353 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead68d expref: 14 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301459:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead68d expref: 13 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.301480:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044128.301483:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044128.301486:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662e00, rc 0) 00000100:00100000:1.0:1784044128.301582:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:10254:x1870705582958720:12345-192.168.204.50@tcp:101:bash.0 Request processed in 2354us (2942us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1784044128.301591:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00010000:00010000:0.0:1784044128.303746:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.303779:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.303787:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.303793:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044128.303798:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.303807:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.303823:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc5fdb200) 00010000:00010000:0.0:1784044128.303826:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044128.303830:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.303837:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550361 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044128.307433:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.309729:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582958848 00000100:00100000:0.0:1784044128.309745:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582958848 00000100:00100000:0.0:1784044128.309835:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1784044128.309845:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1870705582958848:12345-192.168.204.50@tcp:8:bash.0 00010000:00080000:0.0:1784044128.309909:0:8310:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:0.0:1784044128.309945:0:8310:0:(genops.c:1406:class_connect()) connect: client 3609c122-577c-43fa-ab52-dd2c7dc5cce7, cookie 0x9cc73983a7550376 00002000:00100000:0.0:1784044128.309959:0:8310:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3609c122-577c-43fa-ab52-dd2c7dc5cce7/ffff904bc66fc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784044128.310000:0:8310:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784044128.310316:0:8310:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784044128.310368:0:8310:0:(import.c:65:import_set_state_nolock()) ffff904bc66fe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044128.310478:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2344:x1870705582958848:12345-192.168.204.50@tcp:8:bash.0 Request processed in 632us (3056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044128.310487:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:3.0:1784044128.313147:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.313272:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582958976 00000100:00100000:0.0:1784044128.313284:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582958976 00000100:00100000:0.0:1784044128.313452:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1784044128.313465:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:0:x1870705582958976:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044128.313487:0:6571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044128.313526:0:6571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be8bce96/0x9cc73983a755037d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead694 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044128.313561:0:6571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044128.313586:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=306s v=(0 0) 00010000:00010000:0.0:1784044128.313592:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044128.313603:0:6571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be8bce96/0x9cc73983a755037d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead694 expref: 7 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.313628:0:6571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be8bce96/0x9cc73983a755037d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead694 expref: 7 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.313646:0:6571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7000, rc 0) 00000100:00100000:0.0:1784044128.313726:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:0:x1870705582958976:12345-192.168.204.50@tcp:101:bash.0 Request processed in 264us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044128.313756:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00080000:1.0:1784044128.313916:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044128.316912:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044128.317026:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582959104 00000100:00100000:2.0:1784044128.317036:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582959104 00000100:00100000:2.0:1784044128.317102:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:2.0:1784044128.317113:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:10254:x1870705582959104:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1784044128.317132:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044128.317153:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead69b expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.317185:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be8bce96/0x9cc73983a755037d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead694 expref: 8 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.317194:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044128.317198:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044128.317203:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 8 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.317251:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be8bce96/0x9cc73983a755037d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead694 expref: 8 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.317265:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be8bce96/0x9cc73983a755037d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead694 expref: 8 pid: 6571 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044128.317280:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6572:1870705598721664:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044128.317386:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd0049cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044128.320544:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044128.320672:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582959232 00000100:00100000:2.0:1784044128.320682:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582959232 00010000:00010000:2.0:1784044128.320722:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be8bce96/0x9cc73983a755037d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead694 expref: 9 pid: 6571 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044128.320763:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:2.0:1784044128.320773:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2348:x1870705582959232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044128.320787:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044128.321020:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be8bce96/0x9cc73983a755037d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead694 expref: 9 pid: 6571 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.321033:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be8bce96/0x9cc73983a755037d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead694 expref: 9 pid: 6571 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.321064:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044128.321081:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044128.321091:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 9 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.321102:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 9 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.321141:0:5755:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 9 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044128.321155:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5755:1870705598721792:192.168.204.50@tcp:105: 00010000:00010000:3.0:1784044128.321174:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be8bce96/0x9cc73983a755037d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead694 expref: 9 pid: 6571 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044128.321190:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6572:1870705598721664:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044128.321216:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 8 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044128.321227:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5800, rc 0) 00000100:00100000:3.0:1784044128.321744:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:10254:x1870705582959104:12345-192.168.204.50@tcp:101:bash.0 Request processed in 4631us (4886us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044128.321753:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:2.0:1784044128.323744:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd0049d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044128.326026:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5755:1870705598721792:192.168.204.50@tcp:105: 00010000:00010000:3.0:1784044128.326053:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044128.326172:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705582959232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5399us (5647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044128.326183:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:0.0:1784044128.327483:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044128.327650:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582959488 00000100:00100000:2.0:1784044128.327661:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582959488 00000100:00100000:2.0:1784044128.327752:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:2.0:1784044128.327762:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:10254:x1870705582959488:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:2.0:1784044128.328178:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:10254:x1870705582959488:12345-192.168.204.50@tcp:35:bash.0 Request processed in 416us (700us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1784044128.328186:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:1.0:1784044128.407985:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.408287:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582959744 00000100:00100000:0.0:1784044128.408297:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582959744 00000100:00100000:0.0:1784044128.408374:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:0.0:1784044128.408386:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:10264:x1870705582959744:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044128.408422:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044128.408444:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a755038b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6a2 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044128.408590:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1784044128.408713:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a755038b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6a2 expref: 16 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.408727:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:0.0:1784044128.408730:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044128.408735:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a755038b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6a2 expref: 16 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.408754:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6e00, rc 0) 00000100:00100000:0.0:1784044128.409033:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:10264:x1870705582959744:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 649us (1059us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1784044128.409041:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:3.0:1784044128.415930:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.415977:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582960000 00000100:00100000:0.0:1784044128.415987:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582960000 00000100:00100000:0.0:1784044128.416044:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1784044128.416055:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:10264:x1870705582960000:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044128.416368:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:10264:x1870705582960000:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 312us (445us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1784044128.416376:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1784044128.500524:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044128.500648:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582960128 00000100:00100000:2.0:1784044128.500659:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582960128 00000100:00100000:2.0:1784044128.500723:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:2.0:1784044128.500734:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:10270:x1870705582960128:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1784044128.500759:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044128.500781:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6a9 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.500860:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75503a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.500920:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75503a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.500931:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75503a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044128.501002:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1784044128.501006:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044128.501035:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75503a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.501078:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6a9 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.501097:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75503a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6a9 expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.501105:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:2.0:1784044128.501108:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044128.501111:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4000, rc 0) 00000100:00100000:2.0:1784044128.501177:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:10270:x1870705582960128:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 445us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044128.501185:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1784044128.506830:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.506917:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582960384 00000100:00100000:0.0:1784044128.506933:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582960384 00000100:00100000:0.0:1784044128.507079:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:0.0:1784044128.507091:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:10270:x1870705582960384:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044128.507114:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044128.507153:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75503a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6b0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.507276:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75503ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.507293:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75503ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.507308:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75503ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044128.507320:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784044128.507485:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75503a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6b0 expref: 20 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.507504:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75503ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6b0 expref: 19 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.507513:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:0.0:1784044128.507529:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044128.507533:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7200, rc 0) 00000100:00100000:0.0:1784044128.507602:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:10270:x1870705582960384:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 513us (790us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1784044128.507609:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:3.0:1784044128.516000:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044128.516472:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582960640 00000100:00100000:1.0:1784044128.516496:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582960640 00000100:00100000:1.0:1784044128.516570:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:1.0:1784044128.516581:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:10270:x1870705582960640:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044128.516806:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044128.516829:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75503bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6b7 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.516972:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75503c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.516989:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75503c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.517001:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75503c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044128.517034:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:3.0:1784044128.517057:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044128.517130:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582960768 00000100:00100000:2.0:1784044128.517135:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582960768 00010000:00010000:1.0:1784044128.517169:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75503bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6b7 expref: 23 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044128.517179:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:2.0:1784044128.517187:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:2345:x1870705582960768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044128.517197:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044128.517211:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75503ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6b0 expref: 23 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.517227:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:2.0:1784044128.517231:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044128.517290:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:2345:x1870705582960768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044128.517297:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00010000:00010000:1.0:1784044128.517882:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75503c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6b7 expref: 20 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.517893:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044128.517896:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784044128.517898:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663800, rc 0) 00000100:00100000:1.0:1784044128.517939:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:10270:x1870705582960640:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1359us (1949us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1784044128.517946:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:3.0:1784044128.533052:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.533181:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582960896 00000100:00100000:0.0:1784044128.533191:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582960896 00000100:00100000:0.0:1784044128.533304:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:0.0:1784044128.533315:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705582960896:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1784044128.533369:0:6569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.533389:0:6569:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 7 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.533397:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044128.533402:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044128.533407:0:6569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.533445:0:6569:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 7 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.533459:0:6569:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 7 pid: 6572 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044128.533472:0:6569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6569:1870705598721920:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044128.533577:0:6569:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044128.544658:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044128.546029:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582961024 00000100:00100000:2.0:1784044128.546059:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582961024 00002000:00100000:2.0:1784044128.546115:0:6575:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff904bffcaa300 x1870705582961024/t0(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:279/0 lens 504/0 e 0 to 0 dl 1784044139 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044128.546140:0:6575:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bffcaa300 with x1870705582961024 ext(0->12) 00010000:00010000:2.0:1784044128.546151:0:6575:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 8 pid: 6572 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.546167:0:6575:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 8 pid: 6572 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044128.546174:0:6575:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff904bffcaa300 00000100:00100000:2.0:1784044128.546213:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1784044128.546222:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705582961024:12345-192.168.204.50@tcp:4:lfs.0 00000100:00100000:0.0:1784044128.547427:0:6569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6569:1870705598721920:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044128.547457:0:6569:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1784044128.595452:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000100:00100000:2.0:1784044128.596275:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2347:x1870705582961024:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 50047us (51621us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784044128.596287:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00002000:00100000:2.0:1784044128.596301:0:6575:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff904bffcaa300 x1870705582961024/t4294967299(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:279/0 lens 504/448 e 0 to 0 dl 1784044139 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044128.596312:0:6575:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bffcaa300 with x1870705582961024 ext(0->12) 00010000:00010000:2.0:1784044128.596335:0:6575:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 9 pid: 6572 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.596354:0:6575:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 9 pid: 6572 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044128.596377:0:6575:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff904bffcaa300 00000100:00100000:1.0:1784044128.599607:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.599714:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582961152 00000100:00100000:0.0:1784044128.599724:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582961152 00010000:00010000:0.0:1784044128.599766:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 9 pid: 6572 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044128.599824:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:0.0:1784044128.599844:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2345:x1870705582961152:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044128.599858:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784044128.599899:0:5756:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784044128.599902:0:5756:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784044128 00002000:00010000:0.0:1784044128.599905:0:5756:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1784044128 00002000:00010000:0.0:1784044128.599907:0:5756:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784044128 00010000:00010000:0.0:1784044128.599913:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 9 pid: 6572 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.599927:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 9 pid: 6572 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.599963:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550384 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead69b expref: 9 pid: 6572 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.600000:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044128.600004:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044128.600011:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.600021:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.600047:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044128.600103:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2345:x1870705582961152:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 270us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044128.600111:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00010000:00010000:1.0:1784044128.600494:0:6569:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.600506:0:6569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.600535:0:6569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.600543:0:6569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.600562:0:6569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.600570:0:6569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044128.600575:0:6569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.600583:0:6569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.600598:0:6569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.600955:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac12fad/0x9cc73983a75503d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044128.601030:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705582960896:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 67715us (67987us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.601039:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:1.0:1784044128.604839:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.605293:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582961408 00000100:00100000:0.0:1784044128.605303:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582961408 00000100:00100000:0.0:1784044128.605372:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1784044128.605384:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:10270:x1870705582961408:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:0.0:1784044128.605459:0:5773:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75503c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6b7 expref: 20 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044128.606190:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1784044128.606250:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1784044128.607843:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1784044128.608785:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.608809:0:5773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead68d expref: 24 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.608827:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.609273:0:5773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead68d expref: 24 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.609290:0:5773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead68d expref: 24 pid: 5770 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044128.609307:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5773:1870705598722048:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044128.609483:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044128.614392:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5773:1870705598722048:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044128.614436:0:5773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044128.619789:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044128.620303:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582961536 00000100:00100000:2.0:1784044128.620314:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582961536 00010000:00010000:2.0:1784044128.620366:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead68d expref: 25 pid: 5770 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044128.620423:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:2.0:1784044128.620434:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+25:2348:x1870705582961536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044128.620450:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044128.620457:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead68d expref: 25 pid: 5770 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.620472:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead68d expref: 25 pid: 5770 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.620495:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550368 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead68d expref: 25 pid: 5770 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.620514:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:2.0:1784044128.620520:0:8289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.620542:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.620550:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.620598:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044128.620654:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:2348:x1870705582961536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 222us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044128.620662:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00010000:00010000:0.0:1784044128.622421:0:5773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.622436:0:5773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044128.622568:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1784044128.622787:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1784044128.623201:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598722176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784044128.623291:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044128.623408:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044128.626703:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598722176 00000100:00100000:3.0:1784044128.626727:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598722176 00000100:00100000:3.0:1784044128.626809:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044128.626823:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5773:x1870705598722176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784044128.627448:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5773:x1870705598722176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 627us (4155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044128.627458:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784044128.627561:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598722176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1784044128.630928:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1784044128.631094:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598722304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784044128.631179:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044128.631223:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044128.631310:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598722304 00000100:00100000:2.0:1784044128.631319:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598722304 00000100:00100000:2.0:1784044128.631383:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784044128.631402:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5773:x1870705598722304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784044128.632598:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5773:x1870705598722304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1195us (1416us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784044128.632609:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044128.634528:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598722304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1784044128.634631:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1784044128.634690:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.634715:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.634723:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.634729:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044128.634734:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.634741:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.634758:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044128.634761:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784044128.634765:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.634772:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75503d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044128.635078:0:5773:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784044128.635571:0:5773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1784044128.635583:0:5773:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306620718370ns, next at 307620716228ns, rc = 0 00000001:00080000:1.0:1784044128.635592:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1784044128.635628:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044128.635632:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784044128.635640:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75503c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6b7 expref: 28 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044128.635775:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:10270:x1870705582961408:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 30392us (30945us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1784044128.635790:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000020:00080000:1.0:1784044128.635795:0:5773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784044128.639953:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.640043:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582961664 00000100:00100000:0.0:1784044128.640053:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582961664 00000100:00100000:0.0:1784044128.640120:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:0.0:1784044128.640131:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:10270:x1870705582961664:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044128.640160:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044128.640182:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a75503df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6be expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.640282:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a75503df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6be expref: 28 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.640299:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a75503df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6be expref: 28 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.640321:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:0.0:1784044128.640336:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044128.640340:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7c00, rc 0) 00000100:00100000:0.0:1784044128.640406:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:10270:x1870705582961664:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 277us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044128.640414:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:3.0:1784044128.647750:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.647840:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582961920 00000100:00100000:0.0:1784044128.647860:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582961920 00000100:00100000:0.0:1784044128.647956:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1784044128.647980:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfecd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:10270:x1870705582961920:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044128.648218:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfecd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:10270:x1870705582961920:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 239us (478us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1784044128.648225:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1784044128.671426:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044128.671451:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598722432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044128.671521:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044128.674033:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598722432 00000100:00100000:1.0:1784044128.674046:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598722432 00000100:00100000:1.0:1784044128.674106:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784044128.674117:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1870705598722432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044128.674145:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044128.674230:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1870705598722432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (2707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.674238:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784044128.674608:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598722432:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1784044128.723685:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000020:00080000:1.0:1784044128.723708:0:5791:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff904bf5ab76c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1784044128.723714:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bc8b97300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff904bf5ab7600 00000020:00080000:1.0:1784044128.723718:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bc8b97800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff904bc50a9c00 00000004:00080000:1.0:1784044128.723764:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1784044128.723789:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1784044128.723921:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1784044128.724188:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598722560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784044128.724269:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044128.724491:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598722560 00000100:00100000:2.0:1784044128.724499:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598722560 00000100:00100000:2.0:1784044128.724550:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044128.724559:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598722560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784044128.724586:0:8310:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1784044128.724621:0:8310:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a565a60, atime: 0x6a565a60, ctime: 0x6a565a60, blocks: 0x1 00010000:00010000:2.0:1784044128.724629:0:8310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e35241d/0x9cc73983a75503e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.724646:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1784044128.724651:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044128.724658:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e35241d/0x9cc73983a75503e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.724673:0:8310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e35241d/0x9cc73983a75503e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.724699:0:8310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e35241d/0x9cc73983a75503e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.724707:0:8310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e35241d/0x9cc73983a75503e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.724726:0:8310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784044128.725278:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3290:x1870705598722560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 718us (1006us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784044128.725287:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1784044128.725313:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044128.725319:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e35241d/0x9cc73983a75503e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.725338:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044128.725343:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e35241d/0x9cc73983a75503e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.725352:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e35241d/0x9cc73983a75503e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.725369:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e35241d/0x9cc73983a75503e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.725376:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e35241d/0x9cc73983a75503e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.725533:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044128.725536:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044128.725537:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784044128.725571:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904bc5fc9500/2, rc 0, transno 4294967301 00000100:00100000:2.0:1784044128.725578:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598722560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784044128.732959:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044128.734629:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582962176 00000100:00100000:2.0:1784044128.734643:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582962176 00000100:00100000:2.0:1784044128.734709:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1784044128.734718:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+11:10280:x1870705582962176:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1784044128.734834:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044128.734854:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75503ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6c5 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044128.735102:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1784044128.735284:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75503ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6c5 expref: 13 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.735299:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:2.0:1784044128.735302:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044128.735307:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75503ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6c5 expref: 13 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.735320:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4200, rc 0) 00000100:00100000:2.0:1784044128.735583:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+12:10280:x1870705582962176:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 865us (2634us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1784044128.735603:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:3.0:1784044128.738774:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.738941:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582962304 00000100:00100000:0.0:1784044128.738951:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582962304 00000100:00100000:0.0:1784044128.739000:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:0.0:1784044128.739008:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+12:10280:x1870705582962304:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1784044128.739085:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75503fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.739100:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75503fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.739112:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75503fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.739125:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550402 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.739133:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.739154:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.739805:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.739816:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.739824:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044128.740023:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740037:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75503fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740043:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75503fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740050:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75503fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740056:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044128.740061:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75503fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740068:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75503fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740080:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:0.0:1784044128.740088:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044128.740093:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75503fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740099:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75503fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740112:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740118:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550402 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740125:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550402 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740130:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044128.740133:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550402 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740139:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550402 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740145:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bda59a500) 00010000:00010000:0.0:1784044128.740148:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044128.740150:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550402 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740155:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550402 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740169:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740181:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740186:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740191:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044128.740194:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740269:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740277:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:0.0:1784044128.740279:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044128.740282:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044128.740288:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550409 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044128.740424:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+12:10280:x1870705582962304:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1413us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044128.740434:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:3.0:1784044128.743335:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044128.743476:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582962560 00000100:00100000:0.0:1784044128.743632:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582962560 00000100:00100000:0.0:1784044128.743721:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1784044128.743731:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+12:10280:x1870705582962560:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044128.744376:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:10280:x1870705582962560:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 643us (1057us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1784044128.744401:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:3.0:1784044128.772755:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044128.772817:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582962816 00000100:00100000:2.0:1784044128.772827:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582962816 00000100:00100000:2.0:1784044128.772915:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:2.0:1784044128.772925:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:10283:x1870705582962816:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1784044128.772952:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044128.772975:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550410 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6cc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773053:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550417 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773069:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550417 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773080:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550417 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773095:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755041e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773101:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755041e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773106:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755041e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773497:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773517:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773524:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044128.773535:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784044128.773625:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550417 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773633:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550417 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773640:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550417 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773645:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044128.773649:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550417 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773656:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550417 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773668:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:2.0:1784044128.773671:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044128.773676:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550417 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773681:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550417 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773692:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755041e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773705:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755041e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773710:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755041e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773715:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044128.773718:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755041e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773725:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755041e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773732:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bd19d5c00) 00010000:00010000:2.0:1784044128.773734:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044128.773737:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755041e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773743:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755041e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773784:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550410 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6cc expref: 16 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773797:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6cc expref: 15 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044128.773804:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:2.0:1784044128.773807:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044128.773814:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4e00, rc 0) 00000100:00100000:2.0:1784044128.773918:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:10283:x1870705582962816:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 994us (1173us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1784044128.773927:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:3.0:1784044128.778053:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044128.778120:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582962944 00000100:00100000:1.0:1784044128.778129:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582962944 00000100:00100000:1.0:1784044128.778179:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1784044128.778188:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:10283:x1870705582962944:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1784044128.778248:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550433 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.778276:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.778286:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.778309:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.778313:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.778318:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.778332:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044128.778337:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.778345:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550433 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.778362:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044128.778365:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044128.778370:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550433 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044128.778377:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550433 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044128.778472:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:10283:x1870705582962944:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 284us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.778493:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:3.0:1784044128.780514:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044128.780671:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582963200 00000100:00100000:1.0:1784044128.780681:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582963200 00000100:00100000:1.0:1784044128.780738:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044128.780749:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:10283:x1870705582963200:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1784044128.781470:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:10283:x1870705582963200:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 720us (962us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1784044128.781479:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1784044129.067454:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044129.067542:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582963456 00000100:00100000:1.0:1784044129.067555:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582963456 00000100:00100000:1.0:1784044129.067628:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:1.0:1784044129.067639:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:10314:x1870705582963456:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1784044129.067666:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044129.067689:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755043a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6d3 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.067790:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.067804:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.067816:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044129.067826:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784044129.067991:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755043a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6d3 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.068030:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6d3 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.068039:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044129.068043:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044129.068046:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662200, rc 0) 00000100:00100000:1.0:1784044129.068100:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:10314:x1870705582963456:12345-192.168.204.50@tcp:101:cat.0 Request processed in 463us (656us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1784044129.068108:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:2.0:1784044129.072251:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.072577:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582963584 00000100:00100000:0.0:1784044129.072588:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582963584 00000100:00100000:0.0:1784044129.072656:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1784044129.072668:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:2348:x1870705582963584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044129.072686:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044129.072710:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6d3 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.072729:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:0.0:1784044129.072734:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044129.072784:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:2348:x1870705582963584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 118us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.072792:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:2.0:1784044129.073131:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.073327:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582963840 00000100:00100000:0.0:1784044129.073333:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582963840 00000100:00100000:0.0:1784044129.073362:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:0.0:1784044129.073369:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:10314:x1870705582963840:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1784044129.073601:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:10314:x1870705582963840:12345-192.168.204.50@tcp:35:cat.0 Request processed in 231us (470us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1784044129.073608:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00010000:00010000:3.0:1784044129.118482:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044129.130422:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.130602:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582964096 00000100:00100000:0.0:1784044129.130615:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582964096 00000100:00100000:0.0:1784044129.130691:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:0.0:1784044129.130702:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:10320:x1870705582964096:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:0.0:1784044129.130757:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044129.130760:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784044129.130792:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75503a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6a9 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.130813:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:0.0:1784044129.130819:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044129.130833:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755044f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6da expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.131560:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.131581:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6cc expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.131590:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.131625:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6cc expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.131638:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6cc expref: 18 pid: 5771 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044129.131651:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598722688:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044129.131839:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab7180 going to sleep for 11 seconds 00000100:00100000:3.0:1784044129.139208:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.139325:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598722688:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044129.139374:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044129.139651:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582964224 00000100:00100000:2.0:1784044129.139660:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582964224 00010000:00010000:2.0:1784044129.139716:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6cc expref: 19 pid: 5771 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044129.139768:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:2.0:1784044129.139778:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:2348:x1870705582964224:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044129.140102:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044129.140111:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6cc expref: 19 pid: 5771 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.140125:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6cc expref: 19 pid: 5771 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.140149:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550425 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6cc expref: 19 pid: 5771 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.140164:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:2.0:1784044129.140169:0:8289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.140177:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.140615:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.140687:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044129.140764:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:2348:x1870705582964224:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 985us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044129.140773:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00010000:00010000:0.0:1784044129.141168:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.141175:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044129.141198:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784044129.141470:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755044f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6da expref: 19 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.141489:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6da expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.141497:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:0.0:1784044129.141500:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784044129.141502:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7600, rc 0) 00000100:00100000:0.0:1784044129.141595:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:10320:x1870705582964096:12345-192.168.204.50@tcp:101:dd.0 Request processed in 10836us (11125us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1784044129.141606:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:2.0:1784044129.149713:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044129.149760:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.149763:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582964480 00000100:00100000:0.0:1784044129.149773:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582964480 00000100:00100000:0.0:1784044129.149843:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:0.0:1784044129.149855:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705582964480:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044129.149966:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705582964480:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.149991:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:2.0:1784044129.150423:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044129.150527:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044129.150794:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582964608 00000100:00100000:1.0:1784044129.150802:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582964608 00000100:00100000:1.0:1784044129.150852:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582964864 00000100:00100000:1.0:1784044129.150856:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582964864 00000100:00100000:1.0:1784044129.150896:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:1.0:1784044129.150904:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705582964608:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044129.150953:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705582964608:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 49us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044129.150960:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:1.0:1784044129.150975:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:1.0:1784044129.150981:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:10320:x1870705582964864:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:1.0:1784044129.151360:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784044129.151467:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044129.151927:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582964352 00000100:00100000:3.0:1784044129.151935:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582964352 00000100:00100000:3.0:1784044129.151975:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 285 00000100:00100000:3.0:1784044129.151984:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582964352:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044129.152026:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582964352:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 44us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044129.152034:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 285 00010000:00010000:1.0:1784044129.152793:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.152825:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044129.153904:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1784044129.153963:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ead2859 reply state 000000005064eb8f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044129.153975:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044129.154075:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10320:x1870705582964864:12345-192.168.204.50@tcp:36:dd.0 Request processed in 3090us (3544us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1784044129.154083:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000020:00080000:0.0:1784044129.154087:0:5771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784044129.164860:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.164918:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.164927:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.164934:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044129.164939:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.164946:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.164966:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044129.164969:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044129.164984:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.164991:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550464 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044129.493847:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044129.494381:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582964992 00000100:00100000:1.0:1784044129.494397:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582964992 00000100:00100000:1.0:1784044129.494501:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:1.0:1784044129.494515:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:10334:x1870705582964992:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:1.0:1784044129.494574:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044129.494604:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755046b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6e1 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.494715:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550472 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.494734:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550472 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.494747:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550472 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.494765:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550479 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.494773:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.494780:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.497752:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.497792:0:7482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6da expref: 21 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.497803:0:7482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.499504:0:7482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6da expref: 21 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.499550:0:7482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6da expref: 21 pid: 5769 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044129.499573:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598722816:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044129.499729:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd0049300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044129.505371:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044129.505782:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598722816:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044129.505823:0:7482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044129.507392:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582965248 00000100:00100000:0.0:1784044129.507413:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582965248 00000100:00100000:0.0:1784044129.507504:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:0.0:1784044129.507517:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:5565:x1870705582965248:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784044129.508072:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:5565:x1870705582965248:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 556us (2717us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1784044129.508081:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:2.0:1784044129.512142:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044129.512601:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582965376 00000100:00100000:3.0:1784044129.512616:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582965376 00010000:00010000:3.0:1784044129.512675:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6da expref: 23 pid: 5769 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044129.512726:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:3.0:1784044129.512738:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:2348:x1870705582965376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044129.512761:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044129.512771:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6da expref: 23 pid: 5769 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.512789:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6da expref: 23 pid: 5769 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.512832:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550456 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6da expref: 23 pid: 5769 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.512861:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:3.0:1784044129.512930:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.513115:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.513127:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.513168:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044129.513342:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:2348:x1870705582965376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 604us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044129.513351:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00010000:00010000:1.0:1784044129.513804:0:7482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.513827:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044129.514022:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784044129.514028:0:7482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044129.514294:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514322:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514336:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550472 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514343:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550472 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514365:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550472 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514372:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044129.514377:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550472 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514386:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550472 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514400:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044129.514403:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044129.514408:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550472 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514416:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550472 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514432:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514439:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550479 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514445:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550479 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514450:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044129.514454:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550479 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514470:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550479 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514478:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc5fdb600) 00010000:00010000:1.0:1784044129.514481:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044129.514484:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550479 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514490:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550479 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514544:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755046b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e1 expref: 22 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514563:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e1 expref: 21 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.514571:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044129.514574:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044129.514576:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663600, rc 0) 00000100:00100000:1.0:1784044129.514644:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10334:x1870705582964992:12345-192.168.204.50@tcp:101:stat.0 Request processed in 20130us (20833us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044129.514653:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:2.0:1784044129.625708:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.625816:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582965632 00000100:00100000:0.0:1784044129.625827:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582965632 00000100:00100000:0.0:1784044129.625928:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:0.0:1784044129.625940:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10340:x1870705582965632:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:0.0:1784044129.626002:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044129.626044:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550480 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e1 expref: 21 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.626068:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:0.0:1784044129.626088:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044129.626334:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.626349:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.626359:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044129.627613:0:5769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1784044129.627666:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009053e41b reply state 00000000f3ec30db transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044129.627678:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044129.629402:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:10340:x1870705582965632:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 3453us (3695us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1784044129.629417:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000020:00080000:0.0:1784044129.629427:0:5769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784044129.643450:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.643469:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.643480:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.643488:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044129.643492:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.643500:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.643537:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:0.0:1784044129.643540:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044129.643545:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.643552:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550487 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044129.804084:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.804176:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582965760 00000100:00100000:0.0:1784044129.804187:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582965760 00000100:00100000:0.0:1784044129.804245:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:0.0:1784044129.804257:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:10354:x1870705582965760:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:0.0:1784044129.804285:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044129.804319:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a755048e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6e8 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804418:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550495 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804432:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804444:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804460:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755049c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804467:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755049c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804485:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755049c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804829:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804838:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804845:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044129.804905:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1784044129.804910:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044129.804930:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804941:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804949:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804954:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550495 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804960:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804965:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044129.804969:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804983:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550495 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.804995:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:0.0:1784044129.804998:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044129.805001:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550495 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805007:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550495 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805019:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755049c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805024:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755049c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805029:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755049c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805034:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044129.805036:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755049c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805042:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755049c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805048:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bda59a500) 00010000:00010000:0.0:1784044129.805050:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044129.805052:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755049c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805066:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a755049c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805095:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a755048e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e8 expref: 24 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805108:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e8 expref: 23 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.805114:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:0.0:1784044129.805116:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044129.805119:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6200, rc 0) 00000100:00100000:0.0:1784044129.805187:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:10354:x1870705582965760:12345-192.168.204.50@tcp:101:stat.0 Request processed in 932us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.805194:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:2.0:1784044129.868567:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.868816:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582966016 00000100:00100000:0.0:1784044129.868827:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582966016 00000100:00100000:0.0:1784044129.868916:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:0.0:1784044129.868927:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:10364:x1870705582966016:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044129.868950:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044129.868972:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75504aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6ef expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044129.869236:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1784044129.869411:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75504aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6ef expref: 25 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.869438:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:0.0:1784044129.869442:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044129.869447:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75504aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6ef expref: 25 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.869461:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7e00, rc 0) 00000100:00100000:0.0:1784044129.869529:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:10364:x1870705582966016:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 604us (972us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1784044129.869536:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:3.0:1784044129.881291:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.881628:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582966272 00000100:00100000:0.0:1784044129.881638:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582966272 00000100:00100000:0.0:1784044129.881776:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1784044129.881787:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:10364:x1870705582966272:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044129.882228:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+25:10364:x1870705582966272:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 442us (945us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1784044129.882236:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:3.0:1784044129.963656:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.963788:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582966528 00000100:00100000:0.0:1784044129.963797:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582966528 00000100:00100000:0.0:1784044129.963857:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:0.0:1784044129.963900:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+25:10370:x1870705582966528:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044129.963928:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044129.963948:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75504b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6f6 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.964052:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.964127:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e8 expref: 26 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.964136:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.964240:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e8 expref: 26 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.964254:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e8 expref: 26 pid: 5770 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044129.964269:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598722944:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044129.965757:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044129.968275:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044129.968315:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598722944:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044129.968352:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044129.968482:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582966656 00000100:00100000:3.0:1784044129.968489:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582966656 00010000:00010000:3.0:1784044129.968523:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e8 expref: 27 pid: 5770 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044129.968560:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:3.0:1784044129.968569:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:2347:x1870705582966656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044129.968583:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044129.968589:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e8 expref: 27 pid: 5770 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.968600:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e8 expref: 27 pid: 5770 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.968622:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a75504a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6e8 expref: 27 pid: 5770 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.968637:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:3.0:1784044129.968641:0:5757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.968650:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.968669:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044129.968697:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044129.968754:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:2347:x1870705582966656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 185us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044129.968761:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00010000:00010000:1.0:1784044129.969458:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.969476:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044129.969497:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1784044129.969663:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75504b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6f6 expref: 27 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.969680:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6f6 expref: 26 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.969689:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044129.969692:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784044129.969695:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7a00, rc 0) 00000100:00100000:1.0:1784044129.970022:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:10370:x1870705582966528:12345-192.168.204.50@tcp:101:bash.0 Request processed in 6155us (6374us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1784044129.970031:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:3.0:1784044129.972988:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044129.973076:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582966912 00000100:00100000:0.0:1784044129.973086:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582966912 00000100:00100000:0.0:1784044129.973150:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:0.0:1784044129.973160:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:10370:x1870705582966912:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:0.0:1784044129.973565:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.973584:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044129.973595:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044129.973646:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1784044129.973668:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d78eb9e9 reply state 000000002dd19361 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044129.973690:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044129.973829:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:10370:x1870705582966912:12345-192.168.204.50@tcp:36:bash.0 Request processed in 670us (850us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1784044129.973837:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000020:00080000:0.0:1784044129.973842:0:5771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784044129.976409:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.976428:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.976436:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.976442:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044129.976447:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.976479:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.976496:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044129.976499:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044129.976504:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.976509:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75504cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044129.979385:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044129.979611:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582967040 00000100:00100000:1.0:1784044129.979622:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582967040 00000100:00100000:1.0:1784044129.979693:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:1.0:1784044129.979703:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:10370:x1870705582967040:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1784044129.979728:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044129.979749:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead6fd expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.979829:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.979844:0:7482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6f6 expref: 29 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.979852:0:7482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.979923:0:7482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6f6 expref: 29 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.979949:0:7482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6f6 expref: 29 pid: 5770 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044129.979963:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598723072:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044129.980046:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd0049480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044129.983703:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044129.983907:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582967168 00000100:00100000:2.0:1784044129.983915:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582967168 00010000:00010000:2.0:1784044129.983952:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6f6 expref: 30 pid: 5770 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044129.983998:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:2.0:1784044129.984009:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:2348:x1870705582967168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044129.984025:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044129.984031:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6f6 expref: 30 pid: 5770 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.984057:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6f6 expref: 30 pid: 5770 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.984078:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:2.0:1784044129.984083:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.984092:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.984100:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044129.984119:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044129.984173:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:2348:x1870705582967168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 166us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044129.984181:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00010000:00010000:1.0:1784044129.984550:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a75504bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6f6 expref: 29 pid: 5770 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044129.984569:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598723072:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044129.984591:0:7482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.984601:0:7482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.984607:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044129.984664:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784044129.984670:0:7482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044129.984695:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.984731:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6fd expref: 29 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.984748:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6fd expref: 28 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044129.984763:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044129.984767:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044129.984769:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662e00, rc 0) 00000100:00100000:1.0:1784044129.984810:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:10370:x1870705582967040:12345-192.168.204.50@tcp:101:bash.0 Request processed in 5109us (5437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044129.984819:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:0.0:1784044129.987356:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044129.987605:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582967424 00000100:00100000:1.0:1784044129.987615:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582967424 00000100:00100000:1.0:1784044129.987709:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1784044129.987723:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfecc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:10370:x1870705582967424:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:1.0:1784044129.988014:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfecc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:10370:x1870705582967424:12345-192.168.204.50@tcp:35:bash.0 Request processed in 295us (667us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1784044129.988022:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:3.0:1784044130.060025:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.061508:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582967680 00000100:00100000:1.0:1784044130.061522:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582967680 00000100:00100000:1.0:1784044130.061610:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:1.0:1784044130.061623:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:10380:x1870705582967680:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044130.061648:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044130.061670:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead704 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044130.061955:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1784044130.062130:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead704 expref: 31 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.062156:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:1.0:1784044130.062159:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044130.062164:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead704 expref: 31 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.062178:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663800, rc 0) 00000100:00100000:1.0:1784044130.062250:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:10380:x1870705582967680:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 632us (2236us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1784044130.062258:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00080000:3.0:1784044130.062362:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044130.072704:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.072933:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582967808 00000100:00100000:1.0:1784044130.072945:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582967808 00000100:00100000:1.0:1784044130.073011:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1784044130.073021:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:10380:x1870705582967808:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:1.0:1784044130.073099:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073117:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073130:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073145:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75504f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073153:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75504f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073177:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75504f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073729:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073741:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073748:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044130.073793:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073805:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073811:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073818:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073826:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.073830:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073837:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.073849:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044130.073857:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.073862:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.076807:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75504f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.076833:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75504f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.076840:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75504f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.076848:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75504f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.076853:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.076858:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75504f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.080433:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75504f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.080470:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc5fdb600) 00010000:00010000:1.0:1784044130.080473:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.080479:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75504f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.080487:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75504f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.080514:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.080537:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.080544:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.080551:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.080555:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.080561:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.080568:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044130.080571:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.080573:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.080578:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a75504fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044130.080729:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:10380:x1870705582967808:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 7702us (8026us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044130.080740:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:2.0:1784044130.090607:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044130.090822:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582968064 00000100:00100000:0.0:1784044130.090833:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582968064 00000100:00100000:0.0:1784044130.090924:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1784044130.090935:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:10380:x1870705582968064:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044130.091426:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:10380:x1870705582968064:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 490us (825us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1784044130.091436:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00010000:00010000:2.0:1784044130.142221:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044130.150116:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.150395:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582968320 00000100:00100000:1.0:1784044130.150406:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582968320 00000100:00100000:1.0:1784044130.150484:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:1.0:1784044130.150495:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:10383:x1870705582968320:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044130.150524:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044130.150564:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550505 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead70b expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.150670:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755050c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.150685:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755050c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.150696:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755050c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.150709:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550513 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.150715:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.150721:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151560:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a755051a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151573:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a755051a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151581:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a755051a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044130.151590:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784044130.151688:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755050c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151705:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755050c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151712:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755050c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151718:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.151722:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755050c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151729:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755050c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151740:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044130.151743:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.151747:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755050c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151753:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755050c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151766:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151772:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550513 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151777:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151782:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.151790:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151796:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550513 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151803:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc5fdb600) 00010000:00010000:1.0:1784044130.151805:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.151808:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550513 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151813:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550513 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151859:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550505 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead70b expref: 34 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151932:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a755051a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead70b expref: 33 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.151940:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044130.151942:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044130.151944:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904c02177e00, rc 0) 00000100:00100000:1.0:1784044130.152016:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+33:10383:x1870705582968320:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1522us (1910us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1784044130.152025:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:2.0:1784044130.156654:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044130.156701:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044130.156790:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582968576 00000100:00100000:3.0:1784044130.156799:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582968576 00000100:00100000:3.0:1784044130.156891:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:3.0:1784044130.156903:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+33:2347:x1870705582968576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044130.157386:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044130.157419:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177e00/0x9cc73983a755051a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead70b expref: 33 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044130.157452:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:3.0:1784044130.157458:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044130.157522:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:2347:x1870705582968576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 621us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044130.157531:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1784044130.157968:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582968448 00000100:00100000:1.0:1784044130.157974:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582968448 00000100:00100000:1.0:1784044130.158014:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:1.0:1784044130.158022:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:10383:x1870705582968448:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1784044130.158348:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550528 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.158365:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.158375:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.158403:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.158409:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550528 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.158415:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.158421:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.158424:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.158441:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550528 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.158450:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044130.158453:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044130.158456:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550528 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.158462:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550528 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044130.158566:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:10383:x1870705582968448:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 543us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044130.158574:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:2.0:1784044130.165535:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.165679:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582968832 00000100:00100000:1.0:1784044130.165690:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582968832 00000100:00100000:1.0:1784044130.165804:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1784044130.165816:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:10383:x1870705582968832:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1784044130.166374:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+33:10383:x1870705582968832:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 558us (948us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1784044130.166382:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1784044130.327272:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.327503:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582969088 00000100:00100000:1.0:1784044130.327514:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582969088 00000100:00100000:1.0:1784044130.327620:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:1.0:1784044130.327632:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+33:10401:x1870705582969088:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1784044130.327659:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044130.327693:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755052f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead712 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.327820:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550536 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.327836:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.327848:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044130.327904:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784044130.328036:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755052f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead712 expref: 36 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.328058:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550536 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead712 expref: 35 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.328067:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:1.0:1784044130.328070:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784044130.328074:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663600, rc 0) 00000100:00100000:1.0:1784044130.328141:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10401:x1870705582969088:12345-192.168.204.50@tcp:101:cat.0 Request processed in 512us (878us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1784044130.328149:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:3.0:1784044130.352837:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044130.354951:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582969216 00000100:00100000:2.0:1784044130.354967:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582969216 00000100:00100000:2.0:1784044130.355130:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:2.0:1784044130.355144:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10402:x1870705582969216:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1784044130.355206:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044130.355234:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550544 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead719 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044130.355338:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755054b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044130.355355:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755054b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044130.355368:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755054b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044130.355594:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1784044130.355599:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044130.355691:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755054b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044130.355718:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550544 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead719 expref: 37 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044130.355746:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755054b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead719 expref: 36 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044130.355755:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:2.0:1784044130.355758:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044130.355761:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5000, rc 0) 00000100:00100000:2.0:1784044130.355836:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:10402:x1870705582969216:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 695us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044130.355843:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:2.0:1784044130.361663:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044130.361964:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582969600 00000100:00100000:0.0:1784044130.361975:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582969600 00000100:00100000:0.0:1784044130.362038:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:0.0:1784044130.362049:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:10402:x1870705582969600:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044130.362391:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:10402:x1870705582969600:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 343us (749us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1784044130.362399:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:3.0:1784044130.367220:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044130.367374:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582969728 00000100:00100000:2.0:1784044130.367384:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582969728 00000100:00100000:2.0:1784044130.367454:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:2.0:1784044130.367466:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:10402:x1870705582969728:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:2.0:1784044130.367483:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784044130.367511:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a75504db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6fd expref: 37 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044130.367536:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550536 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead712 expref: 36 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044130.367551:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a75503df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead6be expref: 35 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044130.367561:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59ab00) 00010000:00010000:2.0:1784044130.367572:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044130.367642:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:10402:x1870705582969728:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 176us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044130.367650:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1784044130.372431:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044130.372581:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582969856 00000100:00100000:0.0:1784044130.372592:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582969856 00000100:00100000:0.0:1784044130.372656:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:0.0:1784044130.372669:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:10402:x1870705582969856:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:0.0:1784044130.372790:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550552 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044130.372807:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044130.372819:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044130.373607:0:5769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784044130.373814:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1784044130.373917:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1784044130.374017:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:10402:x1870705582969856:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 1348us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044130.374026:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:0.0:1784044130.406036:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.406332:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582969984 00000100:00100000:1.0:1784044130.406342:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582969984 00000100:00100000:1.0:1784044130.406416:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:1.0:1784044130.406428:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:10404:x1870705582969984:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044130.406462:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044130.406485:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550559 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead720 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.406566:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550560 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.406590:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550560 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.406620:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550560 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.406636:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550567 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.406643:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.406660:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407010:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407021:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407028:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044130.407064:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784044130.407068:0:7482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044130.407086:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407099:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407107:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550560 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407125:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550560 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407131:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550560 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407138:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.407142:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550560 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407149:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550560 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407161:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044130.407164:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.407168:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550560 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407174:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550560 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407186:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407198:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550567 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407204:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407209:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.407219:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407225:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407233:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc5fdb600) 00010000:00010000:1.0:1784044130.407236:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.407239:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550567 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407244:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550567 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407277:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550559 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead720 expref: 36 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407302:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead720 expref: 35 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.407310:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59a500) 00010000:00010000:1.0:1784044130.407312:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044130.407315:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662e00, rc 0) 00000100:00100000:1.0:1784044130.407385:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10404:x1870705582969984:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 960us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044130.407392:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00000040:00080000:0.0:1784044130.913268:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044130.913277:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044130.913346:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784044130.913354:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044130.913511:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffcaaa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598723200:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044130.917340:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044130.926410:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044130.926563:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffcaaa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598723200:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784044130.926950:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582970112 00000100:00100000:1.0:1784044130.926960:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582970112 00000100:00100000:1.0:1784044130.927063:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:1.0:1784044130.927075:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10415:x1870705582970112:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784044130.927204:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10415:x1870705582970112:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 Request processed in 131us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044130.927213:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:2.0:1784044130.937497:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.938527:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582970240 00000100:00100000:1.0:1784044130.938543:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582970240 00000100:00100000:1.0:1784044130.938659:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:1.0:1784044130.938672:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10415:x1870705582970240:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784044130.938719:0:5769:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784044130.938903:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10415:x1870705582970240:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 233us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044130.938912:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:3.0:1784044130.944341:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.944527:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582970368 00000100:00100000:1.0:1784044130.944541:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582970368 00000100:00100000:1.0:1784044130.944615:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:1.0:1784044130.944627:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10415:x1870705582970368:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784044130.944727:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550575 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944749:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550575 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944764:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550575 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944783:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a755057c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944790:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a755057c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944808:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a755057c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944842:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944851:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944857:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044130.944923:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784044130.944929:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044130.944943:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944957:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550575 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944964:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550575 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944972:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550575 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944979:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.944984:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550575 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.944993:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550575 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945014:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:1.0:1784044130.945017:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.945023:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550575 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945030:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550575 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945047:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a755057c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945053:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a755057c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945059:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a755057c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945065:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.945068:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a755057c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945075:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a755057c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945082:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044130.945084:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.945087:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a755057c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945094:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a755057c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945121:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945128:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945246:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945251:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.945254:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945260:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945269:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59a500) 00010000:00010000:1.0:1784044130.945271:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.945274:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.945289:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550583 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044130.945581:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10415:x1870705582970368:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 954us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044130.945592:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:0.0:1784044130.955070:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.956911:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582970624 00000100:00100000:1.0:1784044130.956929:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582970624 00000100:00100000:1.0:1784044130.957012:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:1.0:1784044130.957034:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10415:x1870705582970624:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044130.957063:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044130.957096:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a755058a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead727 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957434:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550591 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957454:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957469:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044130.957483:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784044130.957614:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957622:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550591 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957629:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957636:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.957641:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957649:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550591 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957663:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59a500) 00010000:00010000:1.0:1784044130.957673:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044130.957679:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550591 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957685:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550591 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957735:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a755058a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead727 expref: 37 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957747:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:1.0:1784044130.957749:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044130.957753:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a755058a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead727 expref: 37 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.957766:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0030200, rc 0) 00000100:00100000:1.0:1784044130.957935:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:10415:x1870705582970624:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 903us (2878us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1784044130.957944:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:2.0:1784044130.969813:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.969913:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582970752 00000100:00100000:1.0:1784044130.969925:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582970752 00000100:00100000:1.0:1784044130.969993:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:1.0:1784044130.970004:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:10415:x1870705582970752:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784044130.970057:0:7482:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784044130.970277:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:10415:x1870705582970752:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 273us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044130.970295:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:2.0:1784044130.979305:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.979473:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582971008 00000100:00100000:1.0:1784044130.979500:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582971008 00000100:00100000:1.0:1784044130.979606:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:1.0:1784044130.979619:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:10415:x1870705582971008:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044130.979655:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044130.979659:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784044130.979698:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755054b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead719 expref: 36 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.979719:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044130.979725:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044130.979742:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a755059f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead72e expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044130.980927:0:5769:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1784044130.981532:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a75505a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.981552:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a75505a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.981565:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a75505a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.981637:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a755059f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead72e expref: 38 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.981659:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a75505a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead72e expref: 37 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.981683:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044130.981686:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044130.981690:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031400, rc 0) 00000100:00100000:1.0:1784044130.981780:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:10415:x1870705582971008:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 2163us (2503us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1784044130.981790:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:2.0:1784044130.985274:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.985408:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582971264 00000100:00100000:1.0:1784044130.985421:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582971264 00000100:00100000:1.0:1784044130.985552:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:1.0:1784044130.985566:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:10415:x1870705582971264:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784044130.985654:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044130.985699:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a75505a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead72e expref: 37 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.985725:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044130.985740:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044130.985768:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75505b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.985785:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75505b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.985796:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75505b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.985813:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75505bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb0814a3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.985840:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75505bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0814a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.985849:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75505bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0814a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986532:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75505b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986543:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75505b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986550:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75505b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986559:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.986564:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75505b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986573:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75505b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986583:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044130.986586:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.986590:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75505b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986596:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75505b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986605:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75505bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0814a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986617:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75505bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0814a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986623:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75505bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0814a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986628:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.986631:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75505bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0814a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986638:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75505bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0814a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986647:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb0814a3d (ffff904bc5fdb200) 00010000:00010000:1.0:1784044130.986650:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044130.986653:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75505bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb0814a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.986660:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75505bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb0814a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044130.986818:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:10415:x1870705582971264:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1253us (1555us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784044130.986827:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:2.0:1784044130.990746:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044130.990849:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582971392 00000100:00100000:1.0:1784044130.990955:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582971392 00000100:00100000:1.0:1784044130.991120:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:1.0:1784044130.991145:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:10415:x1870705582971392:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044130.991174:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044130.991219:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75505c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead735 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.991266:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.991293:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.991310:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.991435:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75505c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead735 expref: 38 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.991458:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead735 expref: 37 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.991467:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:1.0:1784044130.991471:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784044130.991475:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031800, rc 0) 00000100:00100000:1.0:1784044130.991565:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:10415:x1870705582971392:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 425us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044130.991572:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:2.0:1784044130.994440:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044130.994703:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582971648 00000100:00100000:3.0:1784044130.994715:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582971648 00000100:00100000:3.0:1784044130.994782:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:3.0:1784044130.994794:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:10415:x1870705582971648:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784044130.994935:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044130.994956:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044130.994970:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044130.995366:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1784044130.995378:0:7482:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308980512731ns, next at 309980509955ns, rc = 0 00000004:00010000:3.0:1784044130.995485:0:7482:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f4d1ffe reply state 000000004ed98e2a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044130.995496:0:7482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784044130.995613:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+39:10415:x1870705582971648:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 819us (1181us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1784044130.995622:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:2.0:1784044130.997963:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044130.998119:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582971776 00000100:00100000:3.0:1784044130.998142:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582971776 00000100:00100000:3.0:1784044130.998205:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:3.0:1784044130.998215:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+39:10415:x1870705582971776:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044130.998257:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044130.998291:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75505d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead73c expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044130.998369:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75505d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead73c expref: 40 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044130.998388:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75505d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead73c expref: 40 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044130.998411:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:3.0:1784044130.998415:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044130.998420:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a400, rc 0) 00000100:00100000:3.0:1784044130.998481:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:10415:x1870705582971776:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 267us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044130.998490:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 76 00010000:00010000:1.0:1784044130.998964:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.998975:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.998984:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.999000:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ae00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044130.999006:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.999014:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.999040:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:1.0:1784044130.999043:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784044130.999048:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044130.999055:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75505d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044131.002103:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044131.002746:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582971904 00000100:00100000:1.0:1784044131.002760:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582971904 00000100:00100000:1.0:1784044131.002822:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:1.0:1784044131.002832:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1870705582971904:12345-192.168.204.50@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1784044131.002986:0:8310:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:1.0:1784044131.003032:0:8310:0:(genops.c:1406:class_connect()) connect: client 3609c122-577c-43fa-ab52-dd2c7dc5cce7, cookie 0x9cc73983a75505de 00002000:00100000:1.0:1784044131.003047:0:8310:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3609c122-577c-43fa-ab52-dd2c7dc5cce7/ffff904bff69c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784044131.003079:0:8310:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784044131.003416:0:8310:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784044131.003468:0:8310:0:(import.c:65:import_set_state_nolock()) ffff904bc6bc8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044131.003546:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2344:x1870705582971904:12345-192.168.204.50@tcp:8:lhsmtool_posix.0 Request processed in 714us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044131.003908:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:2.0:1784044131.008120:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044131.008225:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582972032 00000100:00100000:1.0:1784044131.008239:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582972032 00000100:00100000:1.0:1784044131.008357:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:1.0:1784044131.008371:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:0:x1870705582972032:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1784044131.009317:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1784044131.082354:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1784044131.082380:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000100:00100000:0.0:1784044131.082980:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:0:x1870705582972032:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 74592us (74853us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784044131.082996:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:1.0:1784044131.087242:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044131.092274:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582972288 00000100:00100000:0.0:1784044131.092315:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582972288 00000100:00100000:2.0:1784044131.092627:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1784044131.092641:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+39:10415:x1870705582972288:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784044131.093014:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:10415:x1870705582972288:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 375us (5783us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1784044131.093023:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1784044131.098038:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044131.098160:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582972544 00000100:00100000:0.0:1784044131.098173:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582972544 00000100:00100000:0.0:1784044131.098290:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:0.0:1784044131.098303:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:10415:x1870705582972544:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784044131.098464:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:10415:x1870705582972544:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 163us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044131.098473:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:2.0:1784044131.102852:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044131.104740:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582972672 00000100:00100000:3.0:1784044131.104757:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582972672 00000100:00100000:3.0:1784044131.104847:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:3.0:1784044131.104861:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:10415:x1870705582972672:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044131.104906:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044131.104936:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75505e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead743 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.105055:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75505ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.105074:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75505ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.106362:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75505ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044131.106423:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044131.106447:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75505ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.106488:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75505e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead743 expref: 42 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.106506:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75505ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead743 expref: 41 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.106517:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:3.0:1784044131.106520:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784044131.106523:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b000, rc 0) 00000100:00100000:3.0:1784044131.106622:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:10415:x1870705582972672:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1763us (3784us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044131.106632:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:2.0:1784044131.110744:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044131.111230:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582972800 00000100:00100000:3.0:1784044131.111243:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582972800 00000100:00100000:3.0:1784044131.111444:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:3.0:1784044131.111461:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582972800:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044131.111484:0:8310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044131.111514:0:8310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a75505f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead74a expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044131.111549:0:8310:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565a63, blocks: 0x1 00010000:00010000:3.0:1784044131.111590:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1784044131.111596:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044131.111609:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a75505f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead74a expref: 6 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.111636:0:8310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a75505f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead74a expref: 6 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.111653:0:8310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9bc00, rc 0) 00000100:00100000:3.0:1784044131.111738:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582972800:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 279us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044131.111748:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:1.0:1784044131.120910:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044131.120967:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582973056 00000100:00100000:3.0:1784044131.120980:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582973056 00000100:00100000:3.0:1784044131.121046:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:3.0:1784044131.121059:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:10415:x1870705582973056:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784044131.121217:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:10415:x1870705582973056:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 160us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044131.121226:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:2.0:1784044131.128996:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044131.129047:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582973184 00000100:00100000:2.0:1784044131.129059:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582973184 00000100:00100000:2.0:1784044131.129125:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:2.0:1784044131.129137:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:10415:x1870705582973184:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044131.129162:0:6571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044131.129193:0:6571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead751 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.129236:0:6571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a75505f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead74a expref: 7 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.129246:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044131.129252:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044131.129257:0:6571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 7 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.129332:0:6571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a75505f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead74a expref: 7 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.129347:0:6571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a75505f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead74a expref: 7 pid: 8310 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044131.129364:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6571:1870705598723328:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044131.129518:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5033900 going to sleep for 11 seconds 00000100:00100000:0.0:1784044131.137693:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6571:1870705598723328:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044131.137749:0:6571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 7 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.137776:0:6571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4200, rc 0) 00000100:00100000:0.0:1784044131.137860:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:10415:x1870705582973184:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 8723us (8874us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044131.137894:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:2.0:1784044131.150016:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044131.150161:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582973312 00000100:00100000:1.0:1784044131.150174:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582973312 00010000:00010000:1.0:1784044131.150230:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a75505f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead74a expref: 7 pid: 8310 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044131.150318:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1784044131.150331:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705582973312:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044131.150362:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044131.150396:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a75505f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead74a expref: 7 pid: 8310 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.150413:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a75505f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead74a expref: 7 pid: 8310 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.150441:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a75505f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead74a expref: 7 pid: 8310 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.150461:0:8289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044131.150483:0:8289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044131.150494:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 6 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.150506:0:8289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 6 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.150579:0:8289:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 6 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044131.150596:0:8289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed966d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8289:1870705598723456:192.168.204.50@tcp:105: 00000100:00100000:1.0:1784044131.150705:0:8289:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044131.156768:0:8289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed966d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8289:1870705598723456:192.168.204.50@tcp:105: 00010000:00010000:1.0:1784044131.156807:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044131.156903:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582973312:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6572us (6899us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044131.156918:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00010000:00010000:3.0:1784044131.166432:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044131.177520:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044131.185615:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582973440 00000100:00100000:3.0:1784044131.185636:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582973440 00002000:00100000:3.0:1784044131.185713:0:6577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff904beb0f7480 x1870705582973440/t0(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:282/0 lens 504/0 e 0 to 0 dl 1784044142 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784044131.185726:0:6577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904beb0f7480 with x1870705582973440 ext(0->8) 00002000:00010000:3.0:1784044131.185732:0:6577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904beb0f7480 00000100:00100000:2.0:1784044131.185999:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1784044131.186013:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582973440:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784044131.186420:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1784044131.186430:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1784044131.186835:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705582973440:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 822us (9326us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784044131.186846:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00002000:00100000:2.0:1784044131.186856:0:6576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff904beb0f7480 x1870705582973440/t4294967302(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:282/0 lens 504/448 e 0 to 0 dl 1784044142 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044131.186884:0:6576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904beb0f7480 with x1870705582973440 ext(0->8) 00002000:00010000:2.0:1784044131.186889:0:6576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904beb0f7480 00000100:00100000:3.0:1784044131.197717:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044131.197832:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582973568 00000100:00100000:2.0:1784044131.197857:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582973568 00000100:00100000:2.0:1784044131.197967:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:2.0:1784044131.197980:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:10415:x1870705582973568:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1784044131.272756:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:10415:x1870705582973568:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 74764us (75038us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044131.272772:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00000001:00080000:3.0:1784044131.272823:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:3.0:1784044131.272859:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000020:00080000:3.0:1784044131.273006:0:5791:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1784044131.273018:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1784044131.273032:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1784044131.273051:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1784044131.273062:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1784044131.273200:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598723584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784044131.273265:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044131.274269:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598723584 00000100:00100000:3.0:1784044131.274289:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598723584 00000100:00100000:3.0:1784044131.274470:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044131.274480:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598723584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1784044131.274687:0:6572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784044131.274691:0:6572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784044131 00002000:00010000:3.0:1784044131.274700:0:6572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784044131.274703:0:6572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784044131 -> 1784044131 00002000:00010000:3.0:1784044131.274705:0:6572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784044131.274766:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3291:x1870705598723584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 287us (1499us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784044131.274773:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1784044131.274823:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904bffac3800/2, rc 0, transno 4294967303 00000100:00100000:3.0:1784044131.274831:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598723584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784044131.278423:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044131.279581:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582973696 00000100:00100000:3.0:1784044131.279599:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582973696 00000100:00100000:3.0:1784044131.279682:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:3.0:1784044131.279694:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2348:x1870705582973696:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1784044131.281474:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1784044131.304074:0:11839:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044131.304088:0:11839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044131.304139:0:11839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784044131.304146:0:11839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1784044131.402425:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1784044131.403457:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1784044131.405193:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582973696:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 125486us (126771us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044131.405210:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:0.0:1784044131.413702:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044131.413787:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582973952 00000100:00100000:2.0:1784044131.413800:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582973952 00000100:00100000:2.0:1784044131.413945:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:2.0:1784044131.413958:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:10415:x1870705582973952:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784044131.414037:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044131.414074:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75505ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead743 expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.414096:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:2.0:1784044131.414102:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044131.414143:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.414160:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.414171:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044131.414511:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a373188 reply state 0000000075dc3b19 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044131.414523:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044131.414644:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:10415:x1870705582973952:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 685us (953us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1784044131.414651:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00010000:00010000:1.0:1784044131.419753:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.419774:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.419782:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.419809:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044131.419816:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.419824:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.419852:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:1.0:1784044131.419856:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044131.419887:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.419894:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550601 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044131.425144:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044131.425250:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582974080 00000100:00100000:3.0:1784044131.425264:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582974080 00000100:00100000:3.0:1784044131.425366:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:3.0:1784044131.425379:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582974080:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784044131.425739:0:6572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1784044131.425744:0:6572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1784044131 -> 1784044130 00002000:00010000:3.0:1784044131.425746:0:6572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784044128 00002000:00010000:3.0:1784044131.425749:0:6572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784044131 -> 1784044130 00002000:00010000:3.0:1784044131.425752:0:6572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1784044131.425839:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2345:x1870705582974080:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 462us (710us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784044131.425891:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:0.0:1784044131.430439:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044131.430533:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582974336 00000100:00100000:1.0:1784044131.430545:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582974336 00000100:00100000:1.0:1784044131.430619:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:1.0:1784044131.430631:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:10415:x1870705582974336:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784044131.430719:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.430740:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead735 expref: 13 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.430751:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.430815:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead735 expref: 13 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.430831:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead735 expref: 13 pid: 5771 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044131.430889:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed964000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598723712:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044131.431010:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077000 going to sleep for 11 seconds 00000100:00100000:2.0:1784044131.433639:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed964000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598723712:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044131.433695:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044131.434813:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044131.435199:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582974464 00000100:00100000:2.0:1784044131.435210:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582974464 00010000:00010000:2.0:1784044131.435264:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead735 expref: 14 pid: 5771 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044131.435318:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:2.0:1784044131.435330:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:2348:x1870705582974464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044131.435362:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044131.435372:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead735 expref: 14 pid: 5771 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.435388:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead735 expref: 14 pid: 5771 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.435415:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75505c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead735 expref: 14 pid: 5771 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.435433:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:2.0:1784044131.435448:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.435460:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.435469:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.437091:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044131.437182:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:2348:x1870705582974464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1847us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044131.437194:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00010000:00010000:1.0:1784044131.444819:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.447492:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.449369:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.449389:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.449414:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.449422:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0030a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044131.449428:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.449554:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.449577:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:0.0:1784044131.449580:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784044131.449586:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.449592:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550608 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044131.449732:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+12:10415:x1870705582974336:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 19094us (19297us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784044131.449746:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:0.0:1784044131.453987:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044131.454135:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582974592 00000100:00100000:1.0:1784044131.454150:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582974592 00000100:00100000:1.0:1784044131.454217:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:1.0:1784044131.454229:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705582974592:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784044131.454290:0:6571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.454316:0:6571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 7 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.454327:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044131.454332:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044131.454345:0:6571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.454396:0:6571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 7 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.454412:0:6571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 7 pid: 6571 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044131.454439:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed967b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6571:1870705598723840:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044131.454538:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044131.473382:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044131.473425:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582974720 00000100:00100000:0.0:1784044131.473446:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582974720 00010000:00010000:0.0:1784044131.473500:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 8 pid: 6571 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044131.473564:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:0.0:1784044131.473596:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705582974720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044131.473619:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044131.473653:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 8 pid: 6571 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.473673:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 8 pid: 6571 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.473709:0:5757:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044131.473715:0:5757:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044131.473722:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.473741:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.473771:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044131.473884:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705582974720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 263us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044131.473893:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00010000:00010000:1.0:1784044131.474009:0:6571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e35241d/0x9cc73983a75505fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead751 expref: 7 pid: 6571 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044131.474027:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed967b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6571:1870705598723840:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044131.474056:0:6571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.474068:0:6571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.474076:0:6571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.474107:0:6571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.474129:0:6571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.474138:0:6571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.474147:0:6571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044131.474152:0:6571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.474162:0:6571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.474176:0:6571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.474183:0:6571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018315ac5/0x9cc73983a755060f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044131.474258:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582974592:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 20031us (20282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044131.474268:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:3.0:1784044131.493679:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044131.493770:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582974976 00000100:00100000:2.0:1784044131.493788:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582974976 00000100:00100000:2.0:1784044131.493907:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:2.0:1784044131.493918:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+12:10415:x1870705582974976:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784044131.494009:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550616 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.494027:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.494039:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.494248:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.494261:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75505d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead73c expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.494282:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.494321:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75505d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead73c expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.494357:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75505d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead73c expref: 13 pid: 5769 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044131.494374:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598723968:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044131.494485:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5033b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044131.509715:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044131.509850:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598723968:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044131.509918:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044131.512726:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582975104 00000100:00100000:1.0:1784044131.512743:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582975104 00010000:00010000:1.0:1784044131.512804:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75505d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead73c expref: 14 pid: 5769 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044131.512899:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:1.0:1784044131.512911:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:2348:x1870705582975104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044131.512927:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044131.512934:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75505d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead73c expref: 14 pid: 5769 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.512948:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75505d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead73c expref: 14 pid: 5769 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.512970:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75505d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead73c expref: 14 pid: 5769 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.512989:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:1.0:1784044131.512995:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.513004:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.513011:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.513035:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044131.513111:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:2348:x1870705582975104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 202us (3409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044131.513121:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00010000:00010000:3.0:1784044131.516618:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.516644:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784044131.518584:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1784044131.518847:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1784044131.520096:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1784044131.520252:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5770:1870705598724096:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784044131.521419:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044131.521584:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044131.527090:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598724096 00000100:00100000:0.0:1784044131.527111:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598724096 00000100:00100000:3.0:1784044131.530322:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044131.530449:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5770:x1870705598724096:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784044131.530639:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5770:x1870705598724096:12345-0@lo:1000:mdt00_001.0 Request processed in 205us (9224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044131.531029:0:5770:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1784044131.531037:0:5770:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904bffac3800, transno 4294967303 00000100:00100000:0.0:1784044131.531065:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5770:1870705598724096:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1784044131.534496:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1784044131.534759:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5770:1870705598724224:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784044131.534976:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044131.535015:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be032d900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044131.535722:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1784044131.535736:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1784044131.535962:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044131.535997:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598724224 00000100:00100000:3.0:1784044131.536006:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598724224 00000100:00100000:3.0:1784044131.536044:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044131.536054:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5770:x1870705598724224:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784044131.537633:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5770:x1870705598724224:12345-0@lo:1000:mdt00_001.0 Request processed in 1575us (2652us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784044131.537646:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044131.538646:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5770:1870705598724224:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1784044131.538708:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.538722:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.538732:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.538740:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044131.538746:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.538756:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.538779:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb500) 00010000:00010000:0.0:1784044131.538783:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044131.538788:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.538795:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a755061d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.538843:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.538851:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550552 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.539015:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550552 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.539021:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044131.539025:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550552 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.539032:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550552 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.539043:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59a500) 00010000:00010000:0.0:1784044131.539046:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044131.539049:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550552 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.539056:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550552 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.539086:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.539103:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead720 expref: 16 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.539113:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.539180:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead720 expref: 16 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.539212:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead720 expref: 16 pid: 7482 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044131.539232:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffaa6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598724352:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044131.539405:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be032d900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044131.549527:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044131.549592:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582975232 00000100:00100000:3.0:1784044131.549603:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582975232 00010000:00010000:3.0:1784044131.549654:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead720 expref: 17 pid: 7482 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044131.549706:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:3.0:1784044131.549717:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:2347:x1870705582975232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044131.549736:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044131.549744:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead720 expref: 17 pid: 7482 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.549761:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead720 expref: 17 pid: 7482 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.549792:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59a500) 00010000:00010000:3.0:1784044131.549798:0:8289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.549810:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.549820:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044131.549844:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044131.549937:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:2347:x1870705582975232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 220us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044131.549945:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00010000:00010000:0.0:1784044131.555258:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755056e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead720 expref: 16 pid: 7482 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044131.555298:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffaa6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598724352:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044131.555341:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555366:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555373:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555389:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555396:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555403:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555410:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044131.555428:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555438:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555461:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59a500) 00010000:00010000:0.0:1784044131.555464:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044131.555469:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555475:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550624 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555486:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555493:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550616 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555499:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550616 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555504:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044131.555506:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550616 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555512:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550616 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555520:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bda59a500) 00010000:00010000:0.0:1784044131.555522:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044131.555533:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550616 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044131.555539:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550616 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044131.556144:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784044131.556158:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044131.556191:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1784044131.556198:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044131.556429:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:10415:x1870705582974976:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 62508us (62761us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1784044131.556443:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00000020:00080000:0.0:1784044131.556450:0:5770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1784044131.568097:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044131.568805:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582975488 00000100:00100000:1.0:1784044131.568820:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582975488 00000100:00100000:1.0:1784044131.568924:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:1.0:1784044131.568938:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:10415:x1870705582975488:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784044131.571339:0:5773:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784044131.571469:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1784044131.571546:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.572959:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.572988:0:5773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.573000:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.573007:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.573014:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044131.576322:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784044131.576520:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:10415:x1870705582975488:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 7576us (8425us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1784044131.576549:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000020:00080000:1.0:1784044131.576566:0:5773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784044131.577914:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044131.577930:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.577944:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044131.577949:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.577960:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.577981:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff904bc5fdb200) 00010000:00010000:2.0:1784044131.577984:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784044131.577989:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.577996:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755062b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044131.578042:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044131.578055:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044131.578058:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044132.190219:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784044132.577113:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044132.577123:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044132.577185:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784044132.577194:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784044133.214037:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044133.278467:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598724480:0@lo:400:kworker.0 00000100:00100000:0.0:1784044133.278549:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044133.278692:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598724736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044133.278726:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044133.278772:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598724736 00000100:00100000:3.0:1784044133.278781:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598724736 00000100:00100000:3.0:1784044133.278832:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784044133.278841:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598724736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044133.278890:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044133.278934:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598724736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044133.278941:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1784044133.278961:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044133.278994:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598724736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044133.285989:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044133.286008:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598724608:0@lo:400:kworker.0 00000100:00100000:0.0:1784044133.286145:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044133.286269:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598724480 00000100:00100000:0.0:1784044133.286277:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598724480 00000100:00100000:0.0:1784044133.286321:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1784044133.286329:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598724480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044133.286491:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598724480:12345-0@lo:400:kworker.0 Request processed in 162us (7941us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044133.286498:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1784044133.286544:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598724480:0@lo:400:kworker.0 00000100:00100000:1.0:1784044133.287656:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598724608 00000100:00100000:1.0:1784044133.287666:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598724608 00000100:00100000:1.0:1784044133.287751:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784044133.287762:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598724608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044133.287832:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598724608:12345-0@lo:400:kworker.0 Request processed in 72us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044133.287839:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784044133.288694:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598725120:0@lo:400:kworker.0 00000100:00100000:0.0:1784044133.288907:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044133.288951:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044133.288958:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598724992:0@lo:400:kworker.0 00000100:00100000:0.0:1784044133.288992:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044133.289069:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598725120 00000100:00100000:2.0:1784044133.289076:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598725120 00000100:00100000:2.0:1784044133.289129:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784044133.289137:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3289:x1870705598725120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044133.289184:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3289:x1870705598725120:12345-0@lo:400:kworker.0 Request processed in 38us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044133.289191:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784044133.292140:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044133.292181:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598724864:0@lo:400:kworker.0 00000100:00100000:3.0:1784044133.293427:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598724992 00000100:00100000:3.0:1784044133.293437:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598724992 00000100:00100000:3.0:1784044133.293505:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784044133.293521:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598724992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044133.293596:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598724992:12345-0@lo:400:kworker.0 Request processed in 81us (4602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044133.293603:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1784044133.293642:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044133.293647:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044133.294116:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598724608:0@lo:400:kworker.0 00000100:00100000:0.0:1784044133.294318:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598724992:0@lo:400:kworker.0 00000100:00100000:2.0:1784044133.294322:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044133.294332:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598725120:0@lo:400:kworker.0 00000100:00100000:1.0:1784044133.294422:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598724864 00000100:00100000:1.0:1784044133.294427:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598724864 00000100:00100000:1.0:1784044133.294518:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784044133.294525:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598724864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044133.294573:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598724864:12345-0@lo:400:kworker.0 Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044133.294580:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784044133.294605:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598724864:0@lo:400:kworker.0 00000100:00080000:3.0:1784044133.296910:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1784044133.322974:0:11891:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044133.322985:0:11891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044133.323024:0:11891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784044133.323030:0:11891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784044133.490763:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044133.490897:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582975744 00000100:00100000:1.0:1784044133.490910:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582975744 00000100:00100000:1.0:1784044133.491003:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:1.0:1784044133.491016:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:10434:x1870705582975744:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044133.491054:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044133.491084:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead758 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.491415:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550639 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.491438:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550639 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.491450:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550639 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044133.491462:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000100:00080000:2.0:1784044133.491646:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784044133.492400:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead758 expref: 20 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.492421:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead758 expref: 19 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.492430:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044133.492433:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784044133.492436:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031400, rc 0) 00000100:00100000:1.0:1784044133.492498:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:10434:x1870705582975744:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1484us (1745us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1784044133.492506:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:1.0:1784044133.494814:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044133.498592:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582975872 00000100:00100000:2.0:1784044133.498604:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582975872 00000100:00100000:2.0:1784044133.498695:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:2.0:1784044133.498704:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:10434:x1870705582975872:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:2.0:1784044133.498779:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550647 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.498796:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550647 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.498808:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550647 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.498822:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755064e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.498841:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755064e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.498849:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755064e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499160:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499169:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499177:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044133.499218:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499229:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550647 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499246:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550647 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499252:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550647 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499257:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044133.499261:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550647 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499267:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550647 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499286:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:2.0:1784044133.499289:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044133.499412:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550647 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499419:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550647 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499431:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755064e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499437:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755064e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499443:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755064e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499448:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044133.499451:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755064e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499456:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755064e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499464:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bd19d5000) 00010000:00010000:2.0:1784044133.499466:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044133.499470:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755064e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499476:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755064e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499501:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499506:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499511:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499515:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044133.499518:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499523:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499530:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bd19d5600) 00010000:00010000:2.0:1784044133.499533:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044133.499535:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.499540:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550655 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044133.499652:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:10434:x1870705582975872:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 947us (4844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044133.499660:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:1.0:1784044133.589828:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044133.589891:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582976128 00000100:00100000:1.0:1784044133.589901:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582976128 00000100:00100000:1.0:1784044133.589952:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:1.0:1784044133.589961:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:10437:x1870705582976128:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044133.589980:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044133.589999:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a755065c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead75f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.590075:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550663 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.590089:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.590100:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.590113:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755066a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.590119:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755066a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.590126:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755066a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.590931:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.590943:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.590950:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044133.590960:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1784044133.591050:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591058:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550663 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591072:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550663 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591078:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044133.591083:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550663 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591090:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550663 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591102:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044133.591105:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044133.591109:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550663 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591116:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550663 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591129:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755066a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591134:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755066a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591139:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755066a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591144:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044133.591147:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755066a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591161:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755066a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591170:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc5fdb600) 00010000:00010000:1.0:1784044133.591172:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044133.591175:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755066a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591181:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755066a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591224:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a755065c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead75f expref: 22 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591249:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead75f expref: 21 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.591258:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044133.591260:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044133.591262:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0030a00, rc 0) 00000100:00100000:1.0:1784044133.595221:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10437:x1870705582976128:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5247us (5388us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1784044133.595244:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:1.0:1784044133.602944:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044133.603022:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582976256 00000100:00100000:2.0:1784044133.603031:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582976256 00000100:00100000:2.0:1784044133.603090:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:2.0:1784044133.603110:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10437:x1870705582976256:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:2.0:1784044133.603172:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755067f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.603189:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755067f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.603201:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755067f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.603226:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755067f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.603243:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755067f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.603250:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755067f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.603257:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044133.603261:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755067f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.603268:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755067f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.603279:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:2.0:1784044133.603283:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044133.603287:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755067f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.603293:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a755067f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044133.603359:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10437:x1870705582976256:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 250us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044133.603367:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:2.0:1784044133.619817:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044133.619904:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582976512 00000100:00100000:2.0:1784044133.619915:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582976512 00000100:00100000:2.0:1784044133.619964:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:2.0:1784044133.619974:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfecd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10437:x1870705582976512:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1784044133.620464:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfecd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:10437:x1870705582976512:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 489us (666us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1784044133.620474:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1784044133.671437:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044133.671517:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582976768 00000100:00100000:2.0:1784044133.671528:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582976768 00000100:00100000:2.0:1784044133.671588:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:2.0:1784044133.671599:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:9957:x1870705582976768:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1784044133.671628:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044133.671651:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550686 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead766 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.671776:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.671804:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead75f expref: 23 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.671814:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.671902:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead75f expref: 23 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.671915:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead75f expref: 23 pid: 5769 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044133.671928:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598725248:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044133.672026:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044133.677187:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044133.677403:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582976896 00000100:00100000:1.0:1784044133.677412:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582976896 00010000:00010000:1.0:1784044133.677451:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead75f expref: 24 pid: 5769 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044133.677507:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:1.0:1784044133.677517:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:2348:x1870705582976896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044133.677532:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044133.677540:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead75f expref: 24 pid: 5769 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.677552:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead75f expref: 24 pid: 5769 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.677575:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044133.677580:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.677590:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.677596:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.677613:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044133.677669:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:2348:x1870705582976896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 152us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044133.677677:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00010000:00010000:2.0:1784044133.678136:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead75f expref: 23 pid: 5769 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044133.678153:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598725248:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044133.678172:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.678181:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.678187:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044133.678205:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1784044133.678360:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550686 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead766 expref: 24 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.678376:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead766 expref: 23 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.678408:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:2.0:1784044133.678411:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784044133.678414:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4e00, rc 0) 00000100:00100000:2.0:1784044133.678451:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:9957:x1870705582976768:12345-192.168.204.50@tcp:101:bash.0 Request processed in 6854us (7025us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1784044133.678458:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:0.0:1784044133.687452:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044133.687528:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582977152 00000100:00100000:2.0:1784044133.687538:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582977152 00000100:00100000:2.0:1784044133.687597:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:2.0:1784044133.687606:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:9957:x1870705582977152:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:2.0:1784044133.687923:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.687940:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.687952:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044133.688006:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1784044133.688029:0:7482:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004247a5b3 reply state 00000000073e9940 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044133.688039:0:7482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784044133.688086:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1784044133.688245:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:9957:x1870705582977152:12345-192.168.204.50@tcp:36:bash.0 Request processed in 639us (801us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1784044133.688252:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000020:00080000:2.0:1784044133.688272:0:7482:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1784044133.704742:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.704762:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.704783:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.704790:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044133.704795:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.704802:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.704819:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044133.704822:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044133.704827:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.704834:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755069b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044133.708553:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044133.711572:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582977280 00000100:00100000:1.0:1784044133.711589:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582977280 00000100:00100000:1.0:1784044133.714577:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:1.0:1784044133.714613:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:9957:x1870705582977280:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1784044133.714639:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044133.714661:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75506a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead76d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.714737:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75506a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead76d expref: 27 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.714774:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75506a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead76d expref: 27 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.714806:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044133.714809:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044133.714814:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0030200, rc 0) 00000100:00100000:1.0:1784044133.714904:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:9957:x1870705582977280:12345-192.168.204.50@tcp:101:bash.0 Request processed in 308us (6368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044133.718923:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:3.0:1784044133.719069:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044133.719806:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582977408 00000100:00100000:0.0:1784044133.719818:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582977408 00000100:00080000:2.0:1784044133.719895:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044133.720091:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1784044133.720103:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:9957:x1870705582977408:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044133.720121:0:6569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044133.720141:0:6569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d76bbd32/0x9cc73983a75506a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead774 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044133.720168:0:6569:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a565a62, atime: 0x6a565a60, ctime: 0x6a565a62, blocks: 0xb 00010000:00010000:0.0:1784044133.720189:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:0.0:1784044133.720194:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044133.720203:0:6569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d76bbd32/0x9cc73983a75506a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead774 expref: 7 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044133.720220:0:6569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d76bbd32/0x9cc73983a75506a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead774 expref: 7 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044133.720242:0:6569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6200, rc 0) 00000100:00100000:0.0:1784044133.720308:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:9957:x1870705582977408:12345-192.168.204.50@tcp:101:bash.0 Request processed in 208us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044133.728572:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:3.0:1784044133.729351:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044133.729576:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582977536 00000100:00100000:0.0:1784044133.729586:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582977536 00002000:00010000:0.0:1784044133.729620:0:6575:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1784044133.729624:0:6575:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bf56c0a80 with x1870705582977536 ext(0->18446744073709551615) 00002000:00010000:0.0:1784044133.729636:0:6575:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904bf56c0a80. 00000100:00100000:0.0:1784044133.729699:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:0.0:1784044133.729709:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705582977536:12345-192.168.204.50@tcp:10:bash.0 00002000:00010000:0.0:1784044133.730026:0:6575:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1784044133.730030:0:6575:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1784044130 -> 1784044133 00002000:00010000:0.0:1784044133.730033:0:6575:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1784044128 -> 1784044128 00002000:00010000:0.0:1784044133.730035:0:6575:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784044130 -> 1784044133 00002000:00010000:0.0:1784044133.730037:0:6575:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1784044133.730105:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705582977536:12345-192.168.204.50@tcp:10:bash.0 Request processed in 397us (755us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784044133.730113:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00002000:00010000:0.0:1784044133.730116:0:6575:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1784044133.730119:0:6575:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bf56c0a80 with x1870705582977536 ext(0->18446744073709551615) 00002000:00010000:0.0:1784044133.730124:0:6575:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904bf56c0a80. 00000100:00100000:2.0:1784044133.764093:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044133.764145:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044133.764261:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582977664 00000100:00100000:3.0:1784044133.764271:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582977664 00002000:00100000:3.0:1784044133.764319:0:6576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff904beb0f6680 x1870705582977664/t0(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:284/0 lens 496/0 e 0 to 0 dl 1784044144 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784044133.764330:0:6576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904beb0f6680 with x1870705582977664 ext(0->7) 00002000:00010000:3.0:1784044133.764335:0:6576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904beb0f6680 00000100:00100000:3.0:1784044133.764369:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:3.0:1784044133.764378:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705582977664:12345-192.168.204.50@tcp:4:bash.0 00000100:00100000:3.0:1784044133.764824:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:2347:x1870705582977664:12345-192.168.204.50@tcp:4:bash.0 Request processed in 445us (740us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1784044133.764832:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00002000:00100000:3.0:1784044133.764839:0:6576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff904beb0f6680 x1870705582977664/t4294967307(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:284/0 lens 496/448 e 0 to 0 dl 1784044144 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784044133.764848:0:6576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904beb0f6680 with x1870705582977664 ext(0->7) 00002000:00010000:3.0:1784044133.764851:0:6576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904beb0f6680 00000100:00100000:0.0:1784044133.765029:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582977792 00000100:00100000:0.0:1784044133.765035:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582977792 00000100:00100000:0.0:1784044133.765067:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:0.0:1784044133.765074:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:2347:x1870705582977792:12345-192.168.204.50@tcp:16:kworker.0 00000100:00100000:2.0:1784044133.790831:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044133.790899:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598725376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044133.790978:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044133.791069:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598725376 00000100:00100000:2.0:1784044133.791077:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598725376 00000100:00100000:2.0:1784044133.791134:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784044133.791147:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1870705598725376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044133.791186:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044133.792430:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1870705598725376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1281us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044133.792452:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784044133.793960:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598725376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044133.809308:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044133.809386:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582977920 00000100:00100000:1.0:1784044133.809397:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582977920 00000100:00100000:1.0:1784044133.809454:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:1.0:1784044133.809465:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:10451:x1870705582977920:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:1.0:1784044133.809546:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.809564:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.809575:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.809591:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.809597:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.809618:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810187:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810198:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810207:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044133.810262:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810278:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810285:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810292:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810298:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044133.810303:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810311:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810324:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044133.810334:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044133.810341:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810348:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810364:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810370:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810376:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810382:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044133.810385:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810391:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810400:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc5fdb300) 00010000:00010000:1.0:1784044133.810403:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044133.810406:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810412:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810428:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810440:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810447:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810453:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044133.810457:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810464:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810473:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044133.810475:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044133.810478:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044133.810484:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044133.810568:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:10451:x1870705582977920:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1102us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044133.810577:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 91 00000001:00080000:1.0:1784044133.852425:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1784044133.852452:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1784044133.852467:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1784044133.852603:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582977792:12345-192.168.204.50@tcp:16:kworker.0 Request processed in 87521us (88450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044133.852614:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000001:00080000:2.0:1784044133.882990:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1784044133.883012:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1784044133.910954:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044133.911110:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582978176 00000100:00100000:3.0:1784044133.911121:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582978176 00000100:00100000:3.0:1784044133.911179:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:3.0:1784044133.911200:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:10454:x1870705582978176:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044133.911220:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044133.911253:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead77b expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911331:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75506cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911346:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75506cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911357:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75506cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911371:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75506d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911378:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75506d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911385:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75506d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911781:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75506da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911791:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75506da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911799:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75506da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044133.911822:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784044133.911944:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75506cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911952:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75506cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911957:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75506cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911963:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9b400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044133.911967:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75506cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911976:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75506cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.911987:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:3.0:1784044133.911990:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044133.911994:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75506cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912001:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75506cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912013:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75506d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912019:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75506d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912036:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75506d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912040:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044133.912044:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75506d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912049:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75506d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912056:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044133.912059:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044133.912061:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75506d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912067:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75506d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912108:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead77b expref: 30 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912121:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75506da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead77b expref: 29 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.912127:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:3.0:1784044133.912129:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784044133.912132:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b200, rc 0) 00000100:00100000:3.0:1784044133.912203:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:10454:x1870705582978176:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1003us (1258us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1784044133.912219:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:2.0:1784044133.923994:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044133.924105:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582978304 00000100:00100000:3.0:1784044133.924116:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582978304 00000100:00100000:3.0:1784044133.924178:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:3.0:1784044133.924188:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:10454:x1870705582978304:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:3.0:1784044133.924264:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.924293:0:7482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead766 expref: 29 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.924304:0:7482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.924342:0:7482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead766 expref: 29 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.924356:0:7482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead766 expref: 29 pid: 5769 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044133.924372:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598725504:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044133.924463:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044133.941006:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598725504:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044133.941044:0:7482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044133.941203:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044133.941304:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582978560 00000100:00100000:0.0:1784044133.941312:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582978560 00000100:00100000:0.0:1784044133.941370:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:0.0:1784044133.941381:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:5565:x1870705582978560:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784044133.941861:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:5565:x1870705582978560:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 480us (657us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1784044133.941901:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:2.0:1784044133.949332:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044133.949435:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582978688 00000100:00100000:3.0:1784044133.949457:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582978688 00010000:00010000:3.0:1784044133.949498:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead766 expref: 31 pid: 5769 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044133.949543:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:3.0:1784044133.949552:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:2348:x1870705582978688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044133.949568:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044133.949575:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead766 expref: 31 pid: 5769 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.949589:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead766 expref: 31 pid: 5769 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.949611:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755068d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead766 expref: 31 pid: 5769 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.949628:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:3.0:1784044133.949633:0:8289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.949642:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.949650:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044133.949683:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044133.949741:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:2348:x1870705582978688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 189us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044133.949756:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00010000:00010000:2.0:1784044133.950251:0:7482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.950260:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.950292:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.950298:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.950315:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.950321:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ac00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044133.950325:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.950333:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.950344:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:2.0:1784044133.950347:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044133.950351:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044133.950356:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75506e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044133.950416:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:10454:x1870705582978304:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 26229us (26432us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044133.950425:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:2.0:1784044133.964678:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044133.967476:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582978944 00000100:00100000:3.0:1784044133.967494:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582978944 00000100:00100000:3.0:1784044133.967570:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:3.0:1784044133.967582:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:10454:x1870705582978944:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1784044133.967816:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:10454:x1870705582978944:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 236us (3147us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1784044133.967824:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:3.0:1784044134.137840:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044134.139786:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582979200 00000100:00100000:1.0:1784044134.139803:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582979200 00000100:00100000:1.0:1784044134.139929:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:1.0:1784044134.139940:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:10465:x1870705582979200:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1784044134.139968:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044134.139992:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead782 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140069:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140083:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140097:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140111:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140119:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140124:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140493:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550704 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140503:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140522:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044134.140533:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1784044134.140636:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140643:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140649:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140655:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044134.140659:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140665:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140677:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044134.140681:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044134.140685:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140692:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75506f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140704:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140715:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140728:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140733:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044134.140736:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140742:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140750:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc5fdbf00) 00010000:00010000:1.0:1784044134.140753:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044134.140756:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140760:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75506fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140800:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75506ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead782 expref: 33 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140814:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead782 expref: 32 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.140821:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044134.140822:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044134.140825:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0030a00, rc 0) 00000100:00100000:1.0:1784044134.142420:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:10465:x1870705582979200:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2471us (4579us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1784044134.142453:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:1.0:1784044134.150923:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.151495:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582979456 00000100:00100000:3.0:1784044134.151508:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582979456 00000100:00100000:3.0:1784044134.151584:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:3.0:1784044134.151598:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:10465:x1870705582979456:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1784044134.151902:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+33:10465:x1870705582979456:12345-192.168.204.50@tcp:35:cat.0 Request processed in 306us (1040us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1784044134.151911:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:0.0:1784044134.175197:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044134.175306:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582979712 00000100:00100000:1.0:1784044134.175316:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582979712 00000100:00100000:1.0:1784044134.175378:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:1.0:1784044134.175389:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+33:10466:x1870705582979712:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:1.0:1784044134.175456:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784044134.175487:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550704 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead782 expref: 33 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175512:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75506da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead77b expref: 32 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175525:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75506a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead76d expref: 31 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175535:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044134.175546:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044134.175566:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550712 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175581:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550712 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175590:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550712 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175603:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175626:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175633:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175976:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550720 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175985:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550720 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.175992:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550720 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044134.176692:0:5771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1784044134.176702:0:5771:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312161836565ns, next at 313161834260ns, rc = 0 00010000:00010000:1.0:1784044134.176760:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176770:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176779:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176787:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176793:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176812:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176833:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044134.176859:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550720 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176886:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550720 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176892:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550720 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176898:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044134.176903:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550720 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176910:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550720 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176921:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdb300) 00010000:00010000:1.0:1784044134.176924:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784044134.176928:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550720 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176934:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550720 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176950:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550712 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176956:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550712 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176968:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550712 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176973:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044134.176977:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550712 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176983:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550712 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.176991:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044134.176993:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044134.176996:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550712 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.177002:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550712 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044134.177012:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000279d29fe reply state 0000000008dfa802 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044134.177022:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044134.177103:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:10466:x1870705582979712:12345-192.168.204.50@tcp:36:rm.0 Request processed in 1713us (1914us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1784044134.177111:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 95 00010000:00010000:3.0:1784044134.177715:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044134.177723:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.177731:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044134.177734:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.177741:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.177766:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff904bc5fdb300) 00010000:00010000:3.0:1784044134.177768:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784044134.177772:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.177778:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a7550727 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.177795:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044134.177797:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044134.177798:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044134.185044:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.185063:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.185072:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.185100:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044134.185106:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.185115:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.185134:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc5fdbf00) 00010000:00010000:2.0:1784044134.185137:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044134.185142:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.185148:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550719 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.238808:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044134.253786:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044134.253913:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582979968 00000100:00100000:2.0:1784044134.253925:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582979968 00000100:00100000:2.0:1784044134.253988:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:2.0:1784044134.253999:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:10472:x1870705582979968:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1784044134.254024:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044134.254046:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a755072e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead789 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.254171:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550735 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.254189:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.254229:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.254247:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.254256:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.254263:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784044134.254827:0:5770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1784044134.255033:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255045:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255053:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255086:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255093:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550735 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255100:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255106:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044134.255117:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255125:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550735 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255138:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:2.0:1784044134.255141:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044134.255145:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550735 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255153:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550735 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044134.255166:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000043909f4 reply state 000000003fd5f6fb transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044134.255174:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784044134.255205:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a755072e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead789 expref: 34 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255230:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead789 expref: 33 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.255238:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bd19d5000) 00010000:00010000:2.0:1784044134.255241:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044134.255244:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4a00, rc 0) 00000100:00100000:2.0:1784044134.255304:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:10472:x1870705582979968:12345-192.168.204.50@tcp:101:bash.0 Request processed in 1307us (1528us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1784044134.255313:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 96 00010000:00010000:1.0:1784044134.261018:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.261038:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.261061:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.261068:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044134.261073:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.261081:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.261097:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bd19d5600) 00010000:00010000:1.0:1784044134.261101:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044134.261106:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.261112:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a755073c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044134.270844:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044134.270907:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044134.270941:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044134.271025:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582980224 00000100:00100000:2.0:1784044134.271033:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582980224 00000100:00100000:2.0:1784044134.271088:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582980352 00000100:00100000:2.0:1784044134.271091:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582980352 00000100:00100000:2.0:1784044134.271109:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:2.0:1784044134.271118:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582980352:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044134.271179:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582980352:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044134.271186:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:2.0:1784044134.271201:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:2.0:1784044134.271207:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582980224:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1784044134.271298:0:6571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044134.271320:0:6571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094c64541/0x9cc73983a7550751 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead790 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044134.271349:0:6571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784044134.271365:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=312s v=(0 0) 00010000:00010000:2.0:1784044134.271370:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044134.271391:0:6571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094c64541/0x9cc73983a7550751 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead790 expref: 6 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.271411:0:6571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094c64541/0x9cc73983a7550751 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead790 expref: 6 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.271424:0:6571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5a00, rc 0) 00000100:00100000:2.0:1784044134.271446:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582980224:12345-192.168.204.50@tcp:101:bash.0 Request processed in 239us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044134.271465:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:3.0:1784044134.271580:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582980096 00000100:00100000:3.0:1784044134.271585:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582980096 00000100:00100000:3.0:1784044134.271620:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 287 00000100:00100000:3.0:1784044134.271626:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582980096:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044134.271651:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705582980096:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 25us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.271657:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 287 00000100:00080000:0.0:1784044134.271794:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044134.274478:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044134.274582:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582980480 00000100:00100000:2.0:1784044134.274592:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582980480 00000100:00100000:2.0:1784044134.274651:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:2.0:1784044134.274662:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:10472:x1870705582980480:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1784044134.274680:0:6571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044134.274698:0:6571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead797 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.274728:0:6571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094c64541/0x9cc73983a7550751 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead790 expref: 7 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.274737:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044134.274741:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044134.274746:0:6571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 7 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.274778:0:6571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094c64541/0x9cc73983a7550751 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead790 expref: 7 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.274791:0:6571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094c64541/0x9cc73983a7550751 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead790 expref: 7 pid: 6571 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044134.274804:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6571:1870705598725632:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044134.274933:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5033540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044134.280181:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044134.280286:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.280487:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582980736 00000100:00100000:3.0:1784044134.280497:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582980736 00000100:00100000:3.0:1784044134.280567:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:3.0:1784044134.280576:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582980736:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044134.280651:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582980736:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 76us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.280659:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00080000:0.0:1784044134.280821:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044134.281033:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582980608 00000100:00100000:1.0:1784044134.281038:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582980608 00010000:00010000:1.0:1784044134.281065:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094c64541/0x9cc73983a7550751 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead790 expref: 8 pid: 6571 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044134.281098:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1784044134.281105:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705582980608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044134.281115:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044134.281137:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094c64541/0x9cc73983a7550751 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead790 expref: 8 pid: 6571 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.281168:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094c64541/0x9cc73983a7550751 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead790 expref: 8 pid: 6571 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.281196:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044134.281200:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044134.281209:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 8 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.281229:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 8 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.281270:0:5756:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 8 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044134.281290:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed965500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5756:1870705598725760:192.168.204.50@tcp:105: 00000100:00100000:1.0:1784044134.281358:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf58ad6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784044134.284257:0:6571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094c64541/0x9cc73983a7550751 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead790 expref: 8 pid: 6571 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044134.284283:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6571:1870705598725632:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044134.284313:0:6571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 7 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.284329:0:6571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4800, rc 0) 00000100:00100000:2.0:1784044134.284415:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:10472:x1870705582980480:12345-192.168.204.50@tcp:101:bash.0 Request processed in 9754us (9946us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044134.284424:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:1.0:1784044134.292344:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed965500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5756:1870705598725760:192.168.204.50@tcp:105: 00010000:00010000:1.0:1784044134.292385:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044134.292442:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582980608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 11336us (12268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044134.292453:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:0.0:1784044134.299485:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.299599:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582980992 00000100:00100000:3.0:1784044134.299609:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582980992 00000100:00100000:3.0:1784044134.299682:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:3.0:1784044134.299693:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+33:10472:x1870705582980992:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:3.0:1784044134.300076:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:10472:x1870705582980992:12345-192.168.204.50@tcp:35:bash.0 Request processed in 384us (600us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1784044134.300085:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:3.0:1784044134.551402:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044134.551547:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582981120 00000100:00100000:2.0:1784044134.551558:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582981120 00000100:00100000:2.0:1784044134.551621:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:2.0:1784044134.551631:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:10488:x1870705582981120:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1784044134.551654:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044134.551674:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a755075f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead79e expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.551743:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.551759:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.551770:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044134.551850:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1784044134.551854:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044134.551903:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.551929:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a755075f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead79e expref: 36 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.551949:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead79e expref: 35 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.551957:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:2.0:1784044134.551960:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044134.551963:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5000, rc 0) 00000100:00100000:2.0:1784044134.552035:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10488:x1870705582981120:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 405us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044134.552042:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:0.0:1784044134.563896:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044134.564236:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582981376 00000100:00100000:1.0:1784044134.564246:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582981376 00000100:00100000:1.0:1784044134.564309:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:1.0:1784044134.564335:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:10488:x1870705582981376:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044134.564357:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044134.564388:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755076d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7a5 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.564494:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550774 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.564509:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.564519:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044134.564531:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1784044134.564670:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a755076d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7a5 expref: 38 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.564688:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7a5 expref: 37 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.564696:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bd19d5000) 00010000:00010000:1.0:1784044134.564699:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044134.564702:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663600, rc 0) 00000100:00100000:1.0:1784044134.564765:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:10488:x1870705582981376:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 433us (911us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1784044134.564772:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:0.0:1784044134.570635:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.570739:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582981760 00000100:00100000:3.0:1784044134.570750:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582981760 00000100:00100000:3.0:1784044134.570818:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1784044134.570829:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:2348:x1870705582981760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044134.570846:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044134.570897:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550774 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7a5 expref: 37 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.570917:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bd19d5000) 00010000:00010000:3.0:1784044134.570922:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044134.570981:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:2348:x1870705582981760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 154us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.570988:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:1.0:1784044134.571053:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.571512:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582981632 00000100:00100000:3.0:1784044134.571518:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582981632 00000100:00100000:3.0:1784044134.571553:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:3.0:1784044134.571560:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:10488:x1870705582981632:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044134.571579:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044134.571595:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550782 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7ac expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.571700:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550789 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.571713:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.571723:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044134.571735:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784044134.571854:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550782 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7ac expref: 39 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.571910:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550789 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7ac expref: 38 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.571918:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bd19d5000) 00010000:00010000:3.0:1784044134.571921:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784044134.571924:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a200, rc 0) 00000100:00100000:3.0:1784044134.571956:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+38:10488:x1870705582981632:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 396us (903us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1784044134.571963:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:2.0:1784044134.585240:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044134.585376:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582981888 00000100:00100000:1.0:1784044134.585398:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582981888 00000100:00100000:1.0:1784044134.585457:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:1.0:1784044134.585468:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582981888:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1784044134.585510:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.585532:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 6 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.585541:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044134.585545:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044134.585550:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.585583:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 6 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.585596:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 6 pid: 6571 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044134.585611:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed965180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6572:1870705598725888:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044134.585706:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf58ad0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044134.588245:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed965180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6572:1870705598725888:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044134.588285:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044134.598695:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.598798:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582982016 00000100:00100000:3.0:1784044134.598808:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582982016 00002000:00100000:3.0:1784044134.598858:0:6577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff904beb0f4a80 x1870705582982016/t0(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:285/0 lens 504/0 e 0 to 0 dl 1784044145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784044134.598911:0:6577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904beb0f4a80 with x1870705582982016 ext(0->8) 00010000:00010000:3.0:1784044134.598933:0:6577:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 7 pid: 6571 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.598949:0:6577:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 7 pid: 6571 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044134.598957:0:6577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff904beb0f4a80 00000100:00100000:3.0:1784044134.598977:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1784044134.598986:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705582982016:12345-192.168.204.50@tcp:4:lfs.0 00000100:00100000:3.0:1784044134.599488:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2348:x1870705582982016:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 501us (800us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784044134.599496:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00002000:00100000:3.0:1784044134.599503:0:6577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff904beb0f4a80 x1870705582982016/t4294967302(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:285/0 lens 504/448 e 0 to 0 dl 1784044145 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784044134.599511:0:6577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904beb0f4a80 with x1870705582982016 ext(0->8) 00010000:00010000:3.0:1784044134.599516:0:6577:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 9 pid: 6571 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.599528:0:6577:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 9 pid: 6571 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044134.599536:0:6577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff904beb0f4a80 00000100:00100000:1.0:1784044134.603569:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044134.603664:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582982144 00000100:00100000:0.0:1784044134.603675:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582982144 00010000:00010000:0.0:1784044134.603714:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 9 pid: 6571 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044134.603774:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:0.0:1784044134.603784:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed964e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2346:x1870705582982144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044134.603801:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784044134.603821:0:5755:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784044134.603824:0:5755:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784044134 00002000:00010000:0.0:1784044134.603826:0:5755:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784044134 00002000:00010000:0.0:1784044134.603828:0:5755:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1784044134 00010000:00010000:0.0:1784044134.603833:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 9 pid: 6571 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044134.603846:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 9 pid: 6571 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044134.603914:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006963b883/0x9cc73983a7550758 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead797 expref: 9 pid: 6571 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044134.603932:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044134.603937:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044134.603943:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044134.603954:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044134.603979:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044134.604049:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed964e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2346:x1870705582982144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 266us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044134.604056:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00010000:00010000:2.0:1784044134.604394:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.604415:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.604441:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.604450:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.604458:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.604464:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044134.604469:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.604478:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.604491:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.604499:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7550797 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044134.604574:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2345:x1870705582981888:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 19107us (19344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044134.604584:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:1.0:1784044134.610672:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.611110:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582982400 00000100:00100000:3.0:1784044134.611121:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582982400 00000100:00100000:3.0:1784044134.611178:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:3.0:1784044134.611188:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfecfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+38:10488:x1870705582982400:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:3.0:1784044134.611288:0:5773:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550789 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7ac expref: 38 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784044134.611776:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1784044134.611828:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1784044134.612622:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1784044134.612681:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.612698:0:5773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead789 expref: 42 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.612707:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.612743:0:5773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead789 expref: 42 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.612757:0:5773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead789 expref: 42 pid: 5770 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044134.612771:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5773:1870705598726016:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044134.612979:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39c540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044134.628370:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.628547:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5773:1870705598726016:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044134.628573:0:5773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044134.628680:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582982528 00000100:00100000:1.0:1784044134.628687:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582982528 00010000:00010000:1.0:1784044134.628724:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead789 expref: 43 pid: 5770 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044134.628777:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:1.0:1784044134.628787:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+43:2347:x1870705582982528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044134.628815:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044134.628823:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead789 expref: 43 pid: 5770 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.628835:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead789 expref: 43 pid: 5770 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.628856:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead789 expref: 43 pid: 5770 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.628912:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bd19d5000) 00010000:00010000:1.0:1784044134.628917:0:8289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.628925:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.628933:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.628964:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044134.629009:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+42:2347:x1870705582982528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 225us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044134.629016:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00010000:00010000:3.0:1784044134.629281:0:5773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.629297:0:5773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784044134.629434:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1784044134.629638:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1784044134.629741:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598726144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784044134.629785:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044134.629822:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044134.629899:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598726144 00000100:00100000:2.0:1784044134.629904:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598726144 00000100:00100000:2.0:1784044134.629942:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784044134.629950:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5773:x1870705598726144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784044134.630019:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5773:x1870705598726144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044134.630026:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784044134.631387:0:5773:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1784044134.631411:0:5773:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1784044134.631434:0:5773:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904bc5fc9500, transno 4294967301 00000100:00100000:1.0:1784044134.631447:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598726144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1784044134.632512:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1784044134.632763:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed966a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598726272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784044134.632818:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044134.632985:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf58ad540 going to sleep for 11 seconds 00000100:00100000:3.0:1784044134.637555:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598726272 00000100:00100000:3.0:1784044134.637571:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598726272 00000100:00100000:3.0:1784044134.637642:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044134.637652:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5773:x1870705598726272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784044134.637974:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5773:x1870705598726272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 322us (5154us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784044134.637982:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784044134.639428:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed966a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598726272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1784044134.639518:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1784044134.639573:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.639584:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.639591:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.639597:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ae00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044134.639601:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.639608:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.639623:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bd19d5000) 00010000:00010000:1.0:1784044134.639626:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784044134.639630:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.639651:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a755079e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044134.639881:0:5773:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784044134.639982:0:5773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1784044134.639993:0:5773:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 312625127928ns, next at 313625125760ns, rc = 0 00000001:00080000:1.0:1784044134.640000:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1784044134.640038:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bd19d5000) 00010000:00010000:1.0:1784044134.640042:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784044134.640048:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550789 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7ac expref: 46 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044134.640165:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfecfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+45:10488:x1870705582982400:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 28977us (29502us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1784044134.640175:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000020:00080000:1.0:1784044134.640181:0:5773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784044134.642928:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.643025:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582982656 00000100:00100000:3.0:1784044134.643035:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582982656 00000100:00100000:3.0:1784044134.643091:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:3.0:1784044134.643101:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+45:10488:x1870705582982656:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044134.643124:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044134.643146:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a75507a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7b3 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.643207:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a75507a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7b3 expref: 46 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.643235:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a75507a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7b3 expref: 46 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.643268:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044134.643271:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044134.643283:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9aa00, rc 0) 00000100:00100000:3.0:1784044134.643349:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+46:10488:x1870705582982656:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 249us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.643357:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:3.0:1784044134.651309:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044134.651612:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582982912 00000100:00100000:2.0:1784044134.651622:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582982912 00000100:00100000:2.0:1784044134.651682:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:2.0:1784044134.651693:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+46:10488:x1870705582982912:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1784044134.651956:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+47:10488:x1870705582982912:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 264us (657us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1784044134.651963:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:0.0:1784044134.753268:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.753450:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582983040 00000100:00100000:3.0:1784044134.753460:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582983040 00000100:00100000:3.0:1784044134.754610:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:3.0:1784044134.754639:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+47:10498:x1870705582983040:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:3.0:1784044134.754723:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754741:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754754:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754769:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754776:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754783:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754917:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754925:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754933:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044134.754974:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754986:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754993:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.754999:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755005:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9b000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044134.755010:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755017:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755028:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:3.0:1784044134.755031:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044134.755035:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755047:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755061:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755066:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755072:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755077:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9be00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044134.755080:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755085:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755093:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc7c1e300) 00010000:00010000:3.0:1784044134.755096:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044134.755098:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755104:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755116:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755121:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755132:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755137:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9b400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044134.755140:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755146:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755153:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044134.755156:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044134.755158:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.755163:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044134.755270:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+47:10498:x1870705582983040:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 638us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.755279:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:0.0:1784044134.812450:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.813338:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582983296 00000100:00100000:3.0:1784044134.813349:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582983296 00000100:00100000:3.0:1784044134.813469:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:3.0:1784044134.813480:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+47:10501:x1870705582983296:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044134.813510:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044134.813533:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7ba expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.813626:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.813641:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.813654:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.813667:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.813675:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.813682:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.813823:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75507d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.813832:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75507d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.813840:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75507d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044134.813849:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784044134.814013:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814021:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814035:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814042:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9be00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044134.814047:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814054:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814066:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:3.0:1784044134.814069:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044134.814074:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814080:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a75507c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814095:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814102:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814106:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814111:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9b000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044134.814114:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814129:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814137:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc7c1e300) 00010000:00010000:3.0:1784044134.814140:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044134.814143:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814149:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a75507cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814190:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a75507c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7ba expref: 50 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814204:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75507d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7ba expref: 49 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.814222:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044134.814224:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044134.814227:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b200, rc 0) 00000100:00100000:3.0:1784044134.818848:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+49:10501:x1870705582983296:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 816us (1853us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1784044134.819146:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:0.0:1784044134.824481:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044134.824650:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582983424 00000100:00100000:3.0:1784044134.824660:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582983424 00000100:00100000:3.0:1784044134.824719:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 103 00000100:00100000:3.0:1784044134.824731:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+49:10501:x1870705582983424:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:3.0:1784044134.824824:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75507e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.824841:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75507e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.824854:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75507e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.824899:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75507e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.824906:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75507e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.824912:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75507e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.824918:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044134.824922:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75507e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.824929:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75507e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.824939:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044134.824943:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044134.824947:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75507e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044134.824952:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a75507e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044134.825026:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+49:10501:x1870705582983424:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 297us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.825034:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 103 00000100:00100000:0.0:1784044134.830511:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044134.830711:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582983680 00000100:00100000:2.0:1784044134.830721:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582983680 00000100:00100000:2.0:1784044134.830779:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:2.0:1784044134.830790:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+49:10501:x1870705582983680:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1784044134.831057:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+50:10501:x1870705582983680:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 268us (566us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1784044134.831065:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:0.0:1784044134.949796:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044134.949917:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582983936 00000100:00100000:1.0:1784044134.949928:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582983936 00000100:00100000:1.0:1784044134.950000:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:1.0:1784044134.950011:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+50:10511:x1870705582983936:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1784044134.950036:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044134.950039:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784044134.950067:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead79e expref: 50 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.950095:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044134.950101:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044134.950128:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75507eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7c1 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.950242:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75507f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.950256:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75507f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.950267:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75507f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044134.950278:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1784044134.950402:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a75507eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c1 expref: 52 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.950418:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75507f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c1 expref: 51 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.950425:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:1.0:1784044134.950428:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044134.950431:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662200, rc 0) 00000100:00100000:1.0:1784044134.950483:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+51:10511:x1870705582983936:12345-192.168.204.50@tcp:101:bash.0 Request processed in 474us (696us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1784044134.950498:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:0.0:1784044134.965791:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044134.966687:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582984192 00000100:00100000:2.0:1784044134.966699:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582984192 00000100:00100000:2.0:1784044134.966805:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00100000:2.0:1784044134.966816:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+51:10511:x1870705582984192:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:2.0:1784044134.966896:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784044134.966922:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75507f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c1 expref: 51 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.966944:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75507d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7ba expref: 50 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.966955:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:2.0:1784044134.966960:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044134.967347:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.967361:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.967371:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044134.967425:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1784044134.967449:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000119da478 reply state 000000002fac47fb transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044134.967459:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044134.967680:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:10511:x1870705582984192:12345-192.168.204.50@tcp:36:bash.0 Request processed in 864us (1897us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1784044134.967687:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 105 00000020:00080000:2.0:1784044134.967705:0:5770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784044134.973624:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1784044134.974178:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.974191:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.974230:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.974236:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044134.974242:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.974249:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.974277:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:1.0:1784044134.974280:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044134.974284:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044134.974290:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550800 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044134.975580:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582984320 00000100:00100000:2.0:1784044134.975593:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582984320 00000100:00100000:2.0:1784044134.975702:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:2.0:1784044134.975711:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+51:10511:x1870705582984320:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1784044134.975734:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044134.975751:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7c8 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.975852:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.975891:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.975903:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044134.975931:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784044134.975934:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044134.975950:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.975974:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c8 expref: 53 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.975990:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c8 expref: 52 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044134.975998:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:2.0:1784044134.976006:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044134.976009:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5200, rc 0) 00000100:00100000:2.0:1784044134.976067:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:10511:x1870705582984320:12345-192.168.204.50@tcp:101:bash.0 Request processed in 357us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044134.976073:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:1.0:1784044134.983636:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044134.983704:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582984576 00000100:00100000:1.0:1784044134.983714:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582984576 00000100:00100000:1.0:1784044134.983765:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:1.0:1784044134.983775:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:10511:x1870705582984576:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:1.0:1784044134.984025:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+53:10511:x1870705582984576:12345-192.168.204.50@tcp:35:bash.0 Request processed in 250us (398us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1784044134.984032:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:1.0:1784044135.063723:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044135.063992:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582984704 00000100:00100000:3.0:1784044135.064003:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582984704 00000100:00100000:3.0:1784044135.064141:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 107 00000100:00100000:3.0:1784044135.064152:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+53:10517:x1870705582984704:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044135.064176:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044135.064195:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.064267:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755081c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.064282:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755081c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.064294:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755081c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044135.064352:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1784044135.064365:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044135.064387:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755081c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.064409:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7cf expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.064425:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755081c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7cf expref: 54 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.064450:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:3.0:1784044135.064453:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044135.064456:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b400, rc 0) 00000100:00100000:3.0:1784044135.064519:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+54:10517:x1870705582984704:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 369us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044135.064526:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 107 00000100:00080000:0.0:1784044135.067665:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044135.073044:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.078715:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582984832 00000100:00100000:2.0:1784044135.078730:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582984832 00000100:00100000:2.0:1784044135.078998:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 108 00000100:00100000:2.0:1784044135.079011:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+54:10517:x1870705582984832:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1784044135.079032:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044135.079053:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550823 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7d6 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.079113:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755082a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.079128:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755082a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.079139:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755082a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.079153:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550831 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.079161:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.079167:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.079297:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.079307:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.079315:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044135.079349:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784044135.079353:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044135.080735:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.080752:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.080761:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755082a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.080768:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755082a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.080775:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755082a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.080781:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044135.080786:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755082a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.080793:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755082a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081447:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:2.0:1784044135.081451:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044135.081457:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755082a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081464:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a755082a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081477:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081483:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550831 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081489:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081494:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044135.081497:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081503:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550831 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081510:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bd19d5a00) 00010000:00010000:2.0:1784044135.081512:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044135.081515:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550831 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081520:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550831 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081569:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550823 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7d6 expref: 56 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081583:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7d6 expref: 55 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.081590:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:2.0:1784044135.081592:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044135.081727:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4200, rc 0) 00000100:00100000:2.0:1784044135.082006:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:10517:x1870705582984832:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2997us (8970us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044135.082014:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 108 00000100:00100000:3.0:1784044135.100079:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044135.100194:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.102663:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582985216 00000100:00100000:1.0:1784044135.102678:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582985216 00000100:00100000:1.0:1784044135.102761:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:1.0:1784044135.102772:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:10517:x1870705582985216:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044135.102794:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044135.102827:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755083f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.102966:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.102982:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c8 expref: 56 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.102990:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7d6 expref: 56 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.102998:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.103031:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7d6 expref: 56 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.103044:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7d6 expref: 56 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044135.103057:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed966300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598726400:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044135.103150:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c8 expref: 56 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.103183:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c8 expref: 56 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044135.103192:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed964a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598726528:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044135.103224:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be182a180 going to sleep for 11 seconds 00000100:00100000:0.0:1784044135.106368:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582984960 00000100:00100000:0.0:1784044135.106383:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582984960 00010000:00010000:0.0:1784044135.106426:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7d6 expref: 57 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044135.106533:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:0.0:1784044135.106543:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:2346:x1870705582984960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044135.106558:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044135.106565:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7d6 expref: 57 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.106578:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7d6 expref: 57 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.106610:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:0.0:1784044135.106627:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.106636:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.106643:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044135.106692:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:2346:x1870705582984960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (6622us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044135.106694:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044135.106699:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00010000:00010000:3.0:1784044135.109764:0:5769:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000080bcd8f8 x1870705598726400) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7d6 expref: 56 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.109790:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550838 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7d6 expref: 56 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044135.109859:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed966300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598726400:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044135.109911:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed964a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598726528:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044135.109937:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044135.109944:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.109952:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.109960:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044135.114369:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582985344 00000100:00100000:0.0:1784044135.114384:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582985344 00010000:00010000:0.0:1784044135.114430:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c8 expref: 56 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044135.114465:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:0.0:1784044135.114475:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed966680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:2348:x1870705582985344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044135.114489:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044135.114497:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c8 expref: 56 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.114511:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c8 expref: 56 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.114534:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a755080e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7c8 expref: 56 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.114552:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:0.0:1784044135.114569:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.116259:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.116276:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.116312:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044135.116385:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed966680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:2348:x1870705582985344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1908us (9687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044135.116396:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00010000:00010000:1.0:1784044135.116545:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.116553:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044135.116573:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784044135.116972:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a755083f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7dd expref: 56 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.116994:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7dd expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.117003:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:1.0:1784044135.117006:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784044135.117009:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663600, rc 0) 00000100:00100000:1.0:1784044135.117039:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:10517:x1870705582985216:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 14269us (16845us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1784044135.117046:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:1.0:1784044135.123007:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044135.123293:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582985600 00000100:00100000:0.0:1784044135.123302:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582985600 00000100:00100000:0.0:1784044135.123361:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1784044135.123371:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed964a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:10517:x1870705582985600:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:0.0:1784044135.123387:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044135.123411:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a75507a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7b3 expref: 55 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.123428:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:0.0:1784044135.123433:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044135.123490:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed964a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+54:10517:x1870705582985600:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 120us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044135.123498:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1784044135.138911:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.139027:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582985728 00000100:00100000:1.0:1784044135.139038:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582985728 00000100:00100000:1.0:1784044135.139099:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:1.0:1784044135.139109:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+54:10517:x1870705582985728:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:1.0:1784044135.139234:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.139251:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.139264:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044135.139448:0:5771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1784044135.139545:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+54:10517:x1870705582985728:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 436us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044135.139553:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:2.0:1784044135.154486:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.154602:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582985856 00000100:00100000:1.0:1784044135.154613:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582985856 00000100:00100000:1.0:1784044135.154687:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 111 00000100:00100000:1.0:1784044135.154698:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+54:10517:x1870705582985856:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044135.154721:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044135.154745:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755085b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7e4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.154814:0:7482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.154826:0:7482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755085b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7e4 expref: 55 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.154858:0:7482:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.154889:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755085b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7e4 expref: 55 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.154902:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:1.0:1784044135.154905:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044135.154909:0:7482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755085b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7e4 expref: 55 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.154918:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662e00, rc 0) 00000100:00100000:1.0:1784044135.154979:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:10517:x1870705582985856:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 283us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044135.154987:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 111 00010000:00010000:1.0:1784044135.264063:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784044135.646123:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044135.646132:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044135.646175:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1784044135.646181:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784044135.646320:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598726656:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784044135.646439:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39c480 going to sleep for 11 seconds 00000100:00100000:2.0:1784044135.654996:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.655085:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582985984 00000100:00100000:1.0:1784044135.655095:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582985984 00000100:00100000:1.0:1784044135.655154:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 112 00000100:00100000:1.0:1784044135.655165:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:10518:x1870705582985984:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784044135.655208:0:5771:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784044135.655363:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:10518:x1870705582985984:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 200us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044135.655370:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 112 00000100:00100000:3.0:1784044135.655576:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598726656:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784044135.660230:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.660472:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582986112 00000100:00100000:2.0:1784044135.660481:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582986112 00000100:00100000:2.0:1784044135.660548:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:2.0:1784044135.660559:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:10518:x1870705582986112:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784044135.660631:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550862 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660647:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550862 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660658:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550862 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660717:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550869 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660726:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660733:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660758:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660767:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660773:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044135.660810:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784044135.660814:0:7482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044135.660825:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660837:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550862 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660844:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550862 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660851:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550862 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660895:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044135.660900:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550862 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660908:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550862 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660920:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:2.0:1784044135.660922:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044135.660927:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550862 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660934:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550862 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660947:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660952:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550869 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660958:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550869 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660964:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044135.660967:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550869 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660974:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550869 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.660991:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff904bd19d5a00) 00010000:00010000:2.0:1784044135.660993:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044135.660995:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550869 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.661001:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550869 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.661014:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.661020:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.661026:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.661031:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044135.661034:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.661040:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.661060:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:2.0:1784044135.661062:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044135.661066:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.661072:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.661154:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:10518:x1870705582986112:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 597us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044135.661163:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:0.0:1784044135.673217:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.673373:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582986368 00000100:00100000:1.0:1784044135.673396:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582986368 00000100:00100000:1.0:1784044135.673468:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:1.0:1784044135.673478:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:10518:x1870705582986368:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044135.673500:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044135.673521:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550877 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7eb expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673626:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755087e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673642:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755087e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673653:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755087e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044135.673665:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784044135.673757:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755087e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673764:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755087e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673771:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755087e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673777:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044135.673781:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755087e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673788:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755087e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673810:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:1.0:1784044135.673813:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784044135.673818:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755087e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673823:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755087e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673861:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550877 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7eb expref: 57 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673927:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:1.0:1784044135.673930:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044135.673934:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550877 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7eb expref: 57 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.673944:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662200, rc 0) 00000100:00100000:1.0:1784044135.674001:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:10518:x1870705582986368:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 524us (808us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1784044135.674009:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:1.0:1784044135.680657:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.680757:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582986496 00000100:00100000:2.0:1784044135.680766:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582986496 00000100:00100000:2.0:1784044135.680829:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:2.0:1784044135.680840:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:10518:x1870705582986496:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784044135.680936:0:7482:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784044135.681034:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:10518:x1870705582986496:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 195us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044135.681042:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:0.0:1784044135.684617:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.684748:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582986752 00000100:00100000:1.0:1784044135.684758:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582986752 00000100:00100000:1.0:1784044135.684817:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:1.0:1784044135.684827:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:10518:x1870705582986752:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044135.684848:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044135.684851:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784044135.684914:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755081c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7cf expref: 56 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.684932:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:1.0:1784044135.684937:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044135.684952:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755088c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7f2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044135.685773:0:5771:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1784044135.686177:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.686204:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.686215:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.686280:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a755088c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f2 expref: 58 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.686299:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f2 expref: 57 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.686307:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044135.686310:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044135.686313:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031800, rc 0) 00000100:00100000:1.0:1784044135.686393:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:10518:x1870705582986752:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1567us (1785us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1784044135.686415:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:0.0:1784044135.690225:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.690485:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582987008 00000100:00100000:2.0:1784044135.690496:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582987008 00000100:00100000:2.0:1784044135.690609:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:2.0:1784044135.690621:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:10518:x1870705582987008:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784044135.690684:0:7482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044135.690711:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f2 expref: 57 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.690729:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:2.0:1784044135.690740:0:7482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044135.690760:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a75508a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.690774:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a75508a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.690799:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a75508a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.690816:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75508a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x90364bc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.690824:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75508a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90364bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.690831:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75508a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90364bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691077:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a75508a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691085:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a75508a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691090:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a75508a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691097:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044135.691101:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a75508a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691108:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a75508a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691118:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:2.0:1784044135.691121:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044135.691124:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a75508a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691137:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a75508a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691148:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75508a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90364bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691153:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75508a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90364bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691159:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75508a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90364bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691164:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044135.691167:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75508a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90364bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691173:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75508a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90364bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691180:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x90364bc7 (ffff904bd19d5a00) 00010000:00010000:2.0:1784044135.691183:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044135.691185:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75508a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x90364bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.691336:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75508a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x90364bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.691526:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:10518:x1870705582987008:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 906us (1312us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784044135.691546:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:2.0:1784044135.694166:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.694332:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582987136 00000100:00100000:1.0:1784044135.694345:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582987136 00000100:00100000:1.0:1784044135.694498:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:1.0:1784044135.694509:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:10518:x1870705582987136:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044135.694530:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044135.694563:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75508af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead7f9 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.694601:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.694615:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.694625:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.694723:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75508af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f9 expref: 58 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.694742:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f9 expref: 57 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.694751:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044135.694754:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784044135.694758:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031000, rc 0) 00000100:00100000:1.0:1784044135.694816:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:10518:x1870705582987136:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 309us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044135.694830:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:0.0:1784044135.701590:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.701671:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582987392 00000100:00100000:1.0:1784044135.701683:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582987392 00000100:00100000:1.0:1784044135.701753:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:1.0:1784044135.701765:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:10518:x1870705582987392:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784044135.701897:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.701915:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.701928:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044135.702340:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1784044135.702351:0:5769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313687485761ns, next at 314687482921ns, rc = 0 00000004:00010000:1.0:1784044135.702443:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006772b76f reply state 000000004d4f33c3 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044135.702454:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044135.702626:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:10518:x1870705582987392:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 861us (1057us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1784044135.702635:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:0.0:1784044135.706847:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044135.707235:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582987520 00000100:00100000:3.0:1784044135.707245:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582987520 00000100:00100000:3.0:1784044135.707318:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:3.0:1784044135.707330:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:10518:x1870705582987520:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044135.707364:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044135.707388:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75508c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead800 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.707454:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75508c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead800 expref: 60 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.707471:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75508c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead800 expref: 60 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.707492:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:3.0:1784044135.707495:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044135.707499:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9ac00, rc 0) 00000100:00100000:3.0:1784044135.707562:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:10518:x1870705582987520:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 234us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044135.707585:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 120 00010000:00010000:1.0:1784044135.710106:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.710123:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.710149:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.710156:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0030200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044135.710161:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.710168:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.710184:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044135.710186:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784044135.710201:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.710208:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.710331:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.710532:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582987648 00000100:00100000:1.0:1784044135.710542:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582987648 00000100:00100000:1.0:1784044135.710600:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:1.0:1784044135.710610:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582987648:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784044135.711266:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705582987648:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 655us (937us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1784044135.711275:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00080000:0.0:1784044135.711339:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044135.714551:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.714623:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582987904 00000100:00100000:1.0:1784044135.714634:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582987904 00000100:00100000:1.0:1784044135.714734:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:1.0:1784044135.714745:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:10518:x1870705582987904:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784044135.715042:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:10518:x1870705582987904:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 298us (500us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1784044135.715051:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:2.0:1784044135.717660:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.717746:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582988160 00000100:00100000:1.0:1784044135.717756:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582988160 00000100:00100000:1.0:1784044135.717861:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:1.0:1784044135.717926:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:10518:x1870705582988160:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784044135.718026:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:10518:x1870705582988160:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 118us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044135.718034:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:3.0:1784044135.724910:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.725020:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582988288 00000100:00100000:1.0:1784044135.725030:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582988288 00000100:00100000:1.0:1784044135.725093:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:1.0:1784044135.725104:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:10518:x1870705582988288:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044135.725137:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044135.725158:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead807 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.725243:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75508d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.725268:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75508d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.725283:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75508d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044135.725479:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044135.725503:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75508d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.725531:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030200/0x9cc73983a75508cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead807 expref: 62 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.725720:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75508d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead807 expref: 61 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.725728:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044135.725731:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784044135.725735:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031200, rc 0) 00000100:00100000:1.0:1784044135.725856:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:10518:x1870705582988288:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 753us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044135.725887:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:0.0:1784044135.729805:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.730008:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582988416 00000100:00100000:2.0:1784044135.730019:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582988416 00000100:00100000:2.0:1784044135.730108:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:2.0:1784044135.730118:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705582988416:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044135.730137:0:8310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044135.730158:0:8310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead80e expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044135.730186:0:8310:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565a67, blocks: 0x1 00010000:00010000:2.0:1784044135.730217:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1784044135.730222:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044135.730232:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead80e expref: 8 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.730342:0:8310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead80e expref: 8 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.730417:0:8310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5800, rc 0) 00000100:00100000:2.0:1784044135.730515:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2348:x1870705582988416:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 397us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044135.730522:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:0.0:1784044135.733108:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044135.733198:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582988672 00000100:00100000:3.0:1784044135.733208:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582988672 00000100:00100000:3.0:1784044135.733300:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:3.0:1784044135.733311:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:10518:x1870705582988672:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784044135.733432:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:10518:x1870705582988672:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 122us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044135.733439:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:3.0:1784044135.735699:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.735978:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582988800 00000100:00100000:2.0:1784044135.735986:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582988800 00000100:00100000:2.0:1784044135.736039:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:2.0:1784044135.736061:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:10518:x1870705582988800:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044135.736080:0:6571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044135.736098:0:6571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead815 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.736128:0:6571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead80e expref: 9 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.736137:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044135.736142:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044135.736148:0:6571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 9 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.736185:0:6571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead80e expref: 9 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.736210:0:6571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead80e expref: 9 pid: 8310 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.736226:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6571:1870705598726784:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044135.736488:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5033180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044135.739928:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6571:1870705598726784:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044135.739963:0:6571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 9 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.740005:0:6571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5a00, rc 0) 00000100:00100000:2.0:1784044135.740058:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:10518:x1870705582988800:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 3997us (4365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044135.740067:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:0.0:1784044135.740236:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.740329:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582988928 00000100:00100000:2.0:1784044135.740337:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582988928 00010000:00010000:2.0:1784044135.740373:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead80e expref: 9 pid: 8310 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.740405:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:2.0:1784044135.740414:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2347:x1870705582988928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044135.740427:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044135.740448:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead80e expref: 9 pid: 8310 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.740461:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead80e expref: 9 pid: 8310 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.740482:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead80e expref: 9 pid: 8310 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.740498:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044135.740502:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044135.740510:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 8 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.740526:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 8 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.740566:0:5756:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 8 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.740579:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5756:1870705598726912:192.168.204.50@tcp:105: 00000100:00100000:2.0:1784044135.740631:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5033180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044135.742965:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5756:1870705598726912:192.168.204.50@tcp:105: 00010000:00010000:2.0:1784044135.742989:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044135.743029:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705582988928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2616us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044135.743039:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:0.0:1784044135.746411:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044135.747485:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582989056 00000100:00100000:3.0:1784044135.747498:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582989056 00002000:00100000:3.0:1784044135.747553:0:6576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff904bc6b85180 x1870705582989056/t0(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:286/0 lens 504/0 e 0 to 0 dl 1784044146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784044135.747564:0:6576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bc6b85180 with x1870705582989056 ext(0->12) 00002000:00010000:3.0:1784044135.747570:0:6576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904bc6b85180 00000100:00100000:3.0:1784044135.747602:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:3.0:1784044135.747612:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2348:x1870705582989056:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784044135.748176:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:2348:x1870705582989056:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 563us (1773us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784044135.748185:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00002000:00100000:2.0:1784044135.748202:0:6576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff904bc6b85180 x1870705582989056/t4294967309(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:286/0 lens 504/448 e 0 to 0 dl 1784044146 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044135.748211:0:6576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bc6b85180 with x1870705582989056 ext(0->12) 00002000:00010000:2.0:1784044135.748216:0:6576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904bc6b85180 00000100:00100000:0.0:1784044135.750973:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.751026:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582989184 00000100:00100000:1.0:1784044135.751037:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582989184 00000100:00100000:1.0:1784044135.751100:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:1.0:1784044135.751110:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:10518:x1870705582989184:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784044135.826272:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967371 is committed 00000020:00080000:3.0:1784044135.826297:0:5791:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff904bc50d9600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1784044135.826304:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bc8b97200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff904bc50d9f00 00000020:00080000:3.0:1784044135.826308:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bc8b97a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff904bc5790000 00000001:00080000:3.0:1784044135.826329:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1784044135.826339:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1784044135.826364:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000100:00100000:0.0:1784044135.826412:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:10518:x1870705582989184:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 75297us (75442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044135.826424:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 124 00000004:00080000:3.0:1784044135.826501:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1784044135.826521:0:5791:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff904bf58ad0c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1784044135.826525:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bff9bed00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff904bf58ad180 00000020:00080000:3.0:1784044135.826529:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bff9bec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff904bc5647800 00000004:00080000:3.0:1784044135.826544:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1784044135.826566:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1784044135.826589:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1784044135.827033:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598727168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784044135.827086:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044135.827132:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044135.827145:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598727040:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784044135.827157:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598727168 00000100:00100000:1.0:1784044135.827164:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598727168 00000100:00100000:2.0:1784044135.827181:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044135.827227:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598727040 00000100:00100000:2.0:1784044135.827231:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598727040 00000100:00100000:1.0:1784044135.827234:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784044135.827245:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1870705598727168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784044135.827262:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784044135.827270:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb6a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598727040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784044135.827287:0:8310:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1784044135.827310:0:8310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.827333:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d76bbd32/0x9cc73983a75506a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead774 expref: 9 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.827342:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784044135.827347:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044135.827352:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.827378:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d76bbd32/0x9cc73983a75506a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead774 expref: 9 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.827391:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d76bbd32/0x9cc73983a75506a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead774 expref: 9 pid: 6569 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.827402:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8310:1870705598727296:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044135.827445:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5033c00 going to sleep for 11 seconds 00002000:00010000:1.0:1784044135.827608:0:6572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784044135.827612:0:6572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784044135 00002000:00010000:1.0:1784044135.827615:0:6572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784044135.827617:0:6572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1784044135 -> 1784044135 00002000:00010000:1.0:1784044135.827620:0:6572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1784044135.827955:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598727424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784044135.827985:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044135.828014:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1784044135.828021:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1784044135.828106:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598727168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 863us (1018us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1784044135.828114:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784044135.828127:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598727424 00000100:00100000:1.0:1784044135.828132:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598727424 00000100:00100000:1.0:1784044135.828154:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784044135.828161:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598727424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784044135.828175:0:6572:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1784044135.828207:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a565a66, atime: 0x6a565a66, ctime: 0x6a565a66, blocks: 0x1 00010000:00010000:1.0:1784044135.828214:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b0b7c39/0x9cc73983a75508ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.828225:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:1.0:1784044135.828229:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044135.828236:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b0b7c39/0x9cc73983a75508ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.828250:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b0b7c39/0x9cc73983a75508ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.828260:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b0b7c39/0x9cc73983a75508ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.828286:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b0b7c39/0x9cc73983a75508ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.828310:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044135.828426:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044135.828434:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b0b7c39/0x9cc73983a75508ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.828444:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0030200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044135.828448:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b0b7c39/0x9cc73983a75508ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.828458:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b0b7c39/0x9cc73983a75508ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.828475:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b0b7c39/0x9cc73983a75508ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.828484:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b0b7c39/0x9cc73983a75508ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.828503:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044135.828505:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044135.828507:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044135.828756:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1784044135.828763:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1784044135.828787:0:3288:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff904bed964e00 x1870705598727168/t4294967310(4294967310) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1784044151 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1784044135.828799:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904bed964e00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1784044135.828805:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598727168:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1784044135.828926:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044135.828932:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044135.828984:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3289:x1870705598727424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 821us (996us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784044135.828993:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:2.0:1784044135.829006:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904bf56c1500/2, rc 0, transno 4294967304 00000100:00100000:2.0:1784044135.829013:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598727424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784044135.829088:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.829122:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582989312 00000100:00100000:2.0:1784044135.829128:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582989312 00000100:00100000:2.0:1784044135.829158:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:2.0:1784044135.829166:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:2345:x1870705582989312:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784044135.832728:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8310:1870705598727296:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044135.832758:0:8310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044135.836619:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.837040:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582989440 00000100:00100000:2.0:1784044135.837061:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582989440 00010000:00010000:2.0:1784044135.837107:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d76bbd32/0x9cc73983a75506a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead774 expref: 11 pid: 6569 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.837149:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:2.0:1784044135.837158:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+11:2347:x1870705582989440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044135.837173:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044135.837179:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d76bbd32/0x9cc73983a75506a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead774 expref: 11 pid: 6569 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.837204:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d76bbd32/0x9cc73983a75506a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead774 expref: 11 pid: 6569 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.837230:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d76bbd32/0x9cc73983a75506a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead774 expref: 11 pid: 6569 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.837246:0:5757:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044135.837413:0:5757:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044135.837421:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.837450:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.837484:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044135.837544:0:8310:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.837568:0:8310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.837580:0:8310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.837581:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:2347:x1870705582989440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 421us (974us total) trans 0 rc 0/0 00010000:00010000:0.0:1784044135.837598:0:8310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.837600:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00010000:00010000:0.0:1784044135.837624:0:8310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784044135.838149:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb6a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3290:x1870705598727040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10878us (10966us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1784044135.838158:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1784044135.838197:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904bed964000/2, rc 0, transno 4294967311 00000100:00100000:2.0:1784044135.838207:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598727040:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1784044135.838727:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044135.838735:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.838745:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044135.838749:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.838759:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.838772:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.838780:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff91b1f/0x9cc73983a75508e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.838810:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044135.838812:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044135.838814:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044135.863797:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2345:x1870705582989312:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 34619us (34698us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044135.863811:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000001:00080000:3.0:1784044135.864487:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1784044135.864503:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1784044135.864510:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1784044135.872577:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.872753:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582989696 00000100:00100000:2.0:1784044135.872762:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582989696 00000100:00100000:2.0:1784044135.872823:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:2.0:1784044135.872832:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:10518:x1870705582989696:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784044135.872924:0:7482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044135.872952:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75508d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead807 expref: 15 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.872970:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:2.0:1784044135.872975:0:7482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044135.873005:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.873033:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.873043:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044135.873302:0:7482:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce2c0ebb reply state 00000000adfc1ee4 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.873311:0:7482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044135.873415:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:10518:x1870705582989696:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 582us (847us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1784044135.873422:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 125 00010000:00010000:1.0:1784044135.880860:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.880952:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.880960:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.880967:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044135.880972:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.880980:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.880999:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044135.881002:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044135.881008:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.881014:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044135.884131:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.884236:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582989824 00000100:00100000:2.0:1784044135.884246:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582989824 00000100:00100000:2.0:1784044135.884303:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:2.0:1784044135.884314:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582989824:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784044135.884520:0:6572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784044135.884524:0:6572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1784044135 -> 1784044135 00002000:00010000:2.0:1784044135.884526:0:6572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784044134 00002000:00010000:2.0:1784044135.884528:0:6572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1784044135 -> 1784044135 00002000:00010000:2.0:1784044135.884530:0:6572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784044135.884647:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705582989824:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 334us (525us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1784044135.884654:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:0.0:1784044135.889584:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.889705:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582990080 00000100:00100000:2.0:1784044135.889716:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582990080 00000100:00100000:2.0:1784044135.889790:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:2.0:1784044135.889801:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:10518:x1870705582990080:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784044135.890521:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.890543:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f9 expref: 15 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.890553:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.890591:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f9 expref: 15 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.890606:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f9 expref: 15 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.890621:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598727552:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044135.890907:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5033840 going to sleep for 11 seconds 00000100:00100000:3.0:1784044135.894913:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.895025:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598727552:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044135.895055:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044135.895143:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582990208 00000100:00100000:0.0:1784044135.895152:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582990208 00010000:00010000:0.0:1784044135.895198:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f9 expref: 16 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044135.895398:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:0.0:1784044135.895409:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:2347:x1870705582990208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044135.895423:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044135.895430:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f9 expref: 16 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.895461:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f9 expref: 16 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.895483:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75508b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7f9 expref: 16 pid: 5770 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.895500:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:0.0:1784044135.895505:0:8289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.895514:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.895522:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.895561:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044135.895621:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:2347:x1870705582990208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 214us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044135.895629:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00010000:00010000:1.0:1784044135.895685:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.895699:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.895728:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.895735:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.895742:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.895748:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044135.895753:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.895760:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.895770:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044135.895772:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784044135.895776:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.895781:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a75508fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044135.895822:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:10518:x1870705582990080:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 6023us (6247us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784044135.895831:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:1.0:1784044135.898617:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044135.898716:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582990336 00000100:00100000:3.0:1784044135.898726:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582990336 00000100:00100000:3.0:1784044135.898785:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:3.0:1784044135.898796:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705582990336:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784044135.898839:0:11907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.898861:0:11907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 7 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.898896:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044135.898910:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044135.898915:0:11907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.898952:0:11907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 7 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.898985:0:11907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 7 pid: 6571 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044135.899000:0:11907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11907:1870705598727680:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044135.899184:0:11907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044135.903946:0:11907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11907:1870705598727680:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044135.903979:0:11907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044135.906083:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044135.906499:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582990464 00000100:00100000:0.0:1784044135.906509:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582990464 00010000:00010000:0.0:1784044135.906557:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 8 pid: 6571 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044135.906601:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:0.0:1784044135.906612:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2348:x1870705582990464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044135.906643:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044135.906667:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 8 pid: 6571 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.906682:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 8 pid: 6571 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.906704:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094c64541/0x9cc73983a75508e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead815 expref: 8 pid: 6571 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.906722:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044135.906726:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044135.906731:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.906742:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.906776:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044135.906970:0:11907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.906980:0:11907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.907006:0:11907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.907014:0:11907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.907021:0:11907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.907042:0:11907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044135.907047:0:11907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.907057:0:11907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.907069:0:11907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.907077:0:11907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7fa7cc5/0x9cc73983a7550903 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044135.907221:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705582990464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 609us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044135.907241:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:3.0:1784044135.908075:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582990336:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 9277us (9462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044135.908086:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:1.0:1784044135.910654:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.910765:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582990720 00000100:00100000:2.0:1784044135.910776:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582990720 00000100:00100000:2.0:1784044135.910930:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 127 00000100:00100000:2.0:1784044135.910942:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:10518:x1870705582990720:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784044135.911025:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755090a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.911055:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755090a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.911067:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755090a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.911326:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.911339:0:7482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75508c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead800 expref: 15 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.911748:0:7482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.911785:0:7482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75508c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead800 expref: 15 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.911801:0:7482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75508c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead800 expref: 15 pid: 5771 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.911817:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598727808:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044135.915663:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5033840 going to sleep for 11 seconds 00000100:00100000:2.0:1784044135.919151:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598727808:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044135.919181:0:7482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044135.919470:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044135.919628:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582990848 00000100:00100000:2.0:1784044135.919647:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582990848 00010000:00010000:2.0:1784044135.919680:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75508c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead800 expref: 16 pid: 5771 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044135.919721:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:2.0:1784044135.919731:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+16:2347:x1870705582990848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044135.919745:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044135.919752:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75508c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead800 expref: 16 pid: 5771 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.919763:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75508c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead800 expref: 16 pid: 5771 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.919785:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a75508c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead800 expref: 16 pid: 5771 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.919800:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:2.0:1784044135.919805:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.919814:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.919822:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044135.919850:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044135.919917:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:2347:x1870705582990848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 186us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044135.919934:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00010000:00010000:1.0:1784044135.921042:0:7482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.921055:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784044135.921413:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1784044135.921648:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1784044135.921693:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1784044135.921786:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7482:1870705598727936:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784044135.921844:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044135.922147:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2000 going to sleep for 11 seconds 00000100:00100000:3.0:1784044135.922491:0:11851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598727936 00000100:00100000:3.0:1784044135.922499:0:11851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598727936 00000100:00100000:3.0:1784044135.922667:0:11851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784044135.922677:0:11851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7482:x1870705598727936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784044135.922769:0:11851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7482:x1870705598727936:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044135.922777:0:11851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044135.922837:0:7482:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1784044135.922843:0:7482:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904bed964e00, transno 4294967310 00000100:00100000:1.0:1784044135.922889:0:7482:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff904bed964000 x1870705598727040/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784044151 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044135.922900:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7482:1870705598727936:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1784044135.923403:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1784044135.923464:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7482:1870705598728064:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784044135.923498:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044135.924119:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044135.924197:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598728064 00000100:00100000:0.0:1784044135.924203:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598728064 00000100:00100000:0.0:1784044135.924421:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044135.924433:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7482:x1870705598728064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784044135.924659:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7482:x1870705598728064:12345-0@lo:1000:mdt00_003.0 Request processed in 229us (1158us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1784044135.924728:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044135.924787:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7482:1870705598728064:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1784044135.924820:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.924840:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.924847:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.924854:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044135.924860:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925023:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925040:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bc5fdb600) 00010000:00010000:1.0:1784044135.925043:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044135.925047:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925053:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550911 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925082:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925088:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925093:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925098:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044135.925107:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925113:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925121:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:1.0:1784044135.925123:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044135.925129:0:7482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755085b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7e4 expref: 18 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925140:0:7482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755085b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7e4 expref: 18 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925148:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755085b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7e4 expref: 18 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.925177:0:7482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755085b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7e4 expref: 18 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044135.925200:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5fc9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598728192:192.168.204.50@tcp:105: 00000100:00100000:1.0:1784044135.925468:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1784044135.929136:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5fc9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598728192:192.168.204.50@tcp:105: 00010000:00010000:1.0:1784044135.929166:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929175:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550854 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929404:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550918 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929419:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550918 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929430:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550918 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929441:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550918 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929447:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550918 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929453:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550918 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929458:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0030a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044135.929462:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550918 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929468:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550918 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929478:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:1.0:1784044135.929481:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044135.929484:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550918 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929489:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550918 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929508:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755090a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929513:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755090a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929519:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755090a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929524:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044135.929527:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755090a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929532:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755090a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929540:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:1.0:1784044135.929542:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784044135.929544:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755090a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044135.929549:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a755090a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044135.929945:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044135.929951:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1784044135.930351:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:10518:x1870705582990720:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 19402us (19699us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1784044135.930363:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 127 00000020:00080000:1.0:1784044135.930369:0:7482:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1784044135.930531:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000040:00080000:0.0:1784044135.930885:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1784044135.930898:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784044135.931694:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582990976 00000100:00100000:1.0:1784044135.931705:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582990976 00000100:00100000:1.0:1784044135.931785:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:1.0:1784044135.931795:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:10517:x1870705582990976:12345-192.168.204.50@tcp:49:lfs.0 00000100:00100000:1.0:1784044135.933699:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:10517:x1870705582990976:12345-192.168.204.50@tcp:49:lfs.0 Request processed in 1895us (3157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044135.933713:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:2.0:1784044135.935770:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044135.937227:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582991232 00000100:00100000:0.0:1784044135.937240:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582991232 00000100:00100000:0.0:1784044135.937297:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:0.0:1784044135.937307:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfec9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:10518:x1870705582991232:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784044135.938510:0:5772:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784044135.938847:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1784044135.938963:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.938980:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.938993:0:5772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.939002:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.939009:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.939015:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.939101:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784044135.939217:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfec9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:10518:x1870705582991232:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 1908us (3451us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1784044135.939232:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000020:00080000:0.0:1784044135.939238:0:5772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784044135.942781:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044135.943093:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582991488 00000100:00100000:0.0:1784044135.943103:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582991488 00000100:00100000:0.0:1784044135.943169:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 128 00000100:00100000:0.0:1784044135.943179:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:10517:x1870705582991488:12345-192.168.204.50@tcp:58:lfs.0 00000040:00080000:0.0:1784044135.943775:0:5771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1784044135.943894:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:10517:x1870705582991488:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 687us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044135.943903:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 128 00010000:00010000:3.0:1784044135.961986:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044135.962023:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.962035:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044135.962041:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.962051:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.962071:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff904bda59a800) 00010000:00010000:3.0:1784044135.962075:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784044135.962080:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.962086:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a755091f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.962108:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044135.962110:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044135.962112:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044135.994625:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044135.994815:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582991616 00000100:00100000:3.0:1784044135.994826:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582991616 00000100:00100000:3.0:1784044135.994938:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 129 00000100:00100000:3.0:1784044135.994950:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:10520:x1870705582991616:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044135.994975:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044135.994996:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550926 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead81c expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995062:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a755092d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995094:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a755092d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995106:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a755092d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995121:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550934 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995128:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995134:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995468:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995479:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7dd expref: 21 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995486:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995520:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7dd expref: 21 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044135.995840:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7dd expref: 21 pid: 5769 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044135.995891:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598728320:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044135.995978:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044135.998622:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044135.998715:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598728320:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044135.998740:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044135.999241:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582991872 00000100:00100000:0.0:1784044135.999256:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582991872 00000100:00100000:0.0:1784044135.999302:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1784044135.999310:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:5564:x1870705582991872:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784044135.999733:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:5564:x1870705582991872:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 422us (1118us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1784044135.999740:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:2.0:1784044136.001571:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044136.001784:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582992000 00000100:00100000:0.0:1784044136.001794:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582992000 00010000:00010000:0.0:1784044136.001828:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7dd expref: 23 pid: 5769 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044136.001898:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:0.0:1784044136.001922:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:2347:x1870705582992000:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044136.001936:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044136.001943:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7dd expref: 23 pid: 5769 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.001957:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7dd expref: 23 pid: 5769 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.001980:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550846 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7dd expref: 23 pid: 5769 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.001996:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:0.0:1784044136.002001:0:5757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.002010:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.002018:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.002054:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044136.002099:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:2347:x1870705582992000:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 179us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044136.002106:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00010000:00010000:3.0:1784044136.002360:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002369:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044136.002411:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784044136.002417:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044136.002436:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002448:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002458:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a755092d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002464:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a755092d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002470:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a755092d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002476:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ba00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044136.002479:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a755092d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002497:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a755092d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002506:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:3.0:1784044136.002509:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044136.002513:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a755092d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002518:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a755092d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002528:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002549:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550934 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002555:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550934 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002560:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044136.002563:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550934 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002570:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550934 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002577:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044136.002580:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044136.002582:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550934 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002597:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550934 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002631:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550926 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead81c expref: 22 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002644:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead81c expref: 21 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.002651:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044136.002653:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044136.002655:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b400, rc 0) 00000100:00100000:3.0:1784044136.002696:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10520:x1870705582991616:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 7749us (8082us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044136.002703:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 129 00010000:00010000:1.0:1784044136.290257:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044136.773840:0:11945:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044136.773849:0:11945:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044136.774282:0:11945:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1784044136.774289:0:11945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1784044136.990350:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044136.990361:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044136.990398:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784044136.990406:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044136.990559:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc6b87480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598728448:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044136.990654:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd0478a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044137.005451:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044137.005543:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc6b87480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598728448:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784044137.005792:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582992128 00000100:00100000:1.0:1784044137.005800:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582992128 00000100:00100000:1.0:1784044137.005904:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:1.0:1784044137.005914:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10532:x1870705582992128:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784044137.005947:0:5771:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784044137.006048:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10532:x1870705582992128:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 135us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044137.006056:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00080000:2.0:1784044137.006276:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044137.012839:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044137.012965:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582992384 00000100:00100000:1.0:1784044137.012977:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582992384 00000100:00100000:1.0:1784044137.013042:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 131 00000100:00100000:1.0:1784044137.013052:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:10532:x1870705582992384:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044137.013073:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044137.013092:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550942 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead823 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044137.013227:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550949 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044137.013241:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044137.013251:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044137.013261:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784044137.013423:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550942 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead823 expref: 24 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044137.013440:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550949 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead823 expref: 23 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044137.013449:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:1.0:1784044137.013452:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044137.013455:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0030a00, rc 0) 00000100:00100000:1.0:1784044137.013521:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:10532:x1870705582992384:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 471us (691us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1784044137.013529:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 131 00000100:00100000:0.0:1784044137.026300:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044137.026341:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044137.026433:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582992512 00000100:00100000:1.0:1784044137.026434:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582992768 00000100:00100000:1.0:1784044137.026443:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582992768 00000100:00100000:2.0:1784044137.026444:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582992512 00000100:00100000:1.0:1784044137.026516:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 132 00000100:00100000:2.0:1784044137.026517:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:2.0:1784044137.026530:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:2347:x1870705582992512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1784044137.026546:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:10532:x1870705582992768:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784044137.026547:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044137.026578:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a7550949 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead823 expref: 24 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044137.026601:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:2.0:1784044137.026606:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044137.026621:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550957 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044137.026648:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044137.026658:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:2347:x1870705582992512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 130us (368us total) trans 0 rc 0/0 00010000:00010000:1.0:1784044137.026660:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044137.026673:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00010000:00010000:0.0:1784044137.027222:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044137.027232:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550957 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044137.027238:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550957 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044137.027245:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044137.027250:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550957 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044137.027257:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550957 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044137.027267:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:0.0:1784044137.027270:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044137.027274:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550957 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044137.027281:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550957 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044137.027407:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:10532:x1870705582992768:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 878us (1063us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1784044137.027423:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 132 00000040:00080000:3.0:1784044137.027572:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044137.027577:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044137.028102:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1784044137.028110:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044137.034668:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044137.034953:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582993024 00000100:00100000:1.0:1784044137.034964:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582993024 00000100:00100000:1.0:1784044137.035026:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:1.0:1784044137.035035:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:10532:x1870705582993024:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784044137.035292:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:10532:x1870705582993024:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 256us (632us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1784044137.035300:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00010000:00010000:3.0:1784044137.310201:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044138.336755:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044138.398178:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598728576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044138.398264:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044138.398428:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598728576 00000100:00100000:1.0:1784044138.398438:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598728576 00000100:00100000:1.0:1784044138.398499:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784044138.398511:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3290:x1870705598728576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044138.398548:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044138.401885:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598728832:0@lo:400:kworker.0 00000100:00100000:3.0:1784044138.401973:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044138.402025:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044138.402031:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598728960:0@lo:400:kworker.0 00000100:00100000:3.0:1784044138.402053:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044138.402087:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598728832 00000100:00100000:3.0:1784044138.402109:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598728832 00000100:00100000:3.0:1784044138.402170:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598728960 00000100:00100000:3.0:1784044138.402173:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598728960 00000100:00100000:3.0:1784044138.402199:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784044138.402207:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598728832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044138.402256:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598728832:12345-0@lo:400:kworker.0 Request processed in 50us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044138.402264:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784044138.402281:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784044138.402286:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598728960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044138.402324:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598728960:12345-0@lo:400:kworker.0 Request processed in 38us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044138.402330:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784044138.402375:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598728960:0@lo:400:kworker.0 00000100:00100000:3.0:1784044138.402386:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598728832:0@lo:400:kworker.0 00000100:00100000:0.0:1784044138.402524:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598728704:0@lo:400:kworker.0 00000100:00100000:0.0:1784044138.402572:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044138.402602:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598729216:0@lo:400:kworker.0 00000100:00100000:0.0:1784044138.402624:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044138.402644:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044138.402649:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598729088:0@lo:400:kworker.0 00000100:00100000:0.0:1784044138.402671:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044138.402785:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598728704 00000100:00100000:3.0:1784044138.402790:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598728704 00000100:00100000:3.0:1784044138.402827:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1784044138.402834:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598728704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044138.402900:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598728704:12345-0@lo:400:kworker.0 Request processed in 67us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044138.402907:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1784044138.402939:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598728704:0@lo:400:kworker.0 00000100:00100000:3.0:1784044138.402958:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598729088 00000100:00100000:3.0:1784044138.402962:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598729088 00000100:00100000:3.0:1784044138.402986:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784044138.403001:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598729088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044138.403035:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598729088:12345-0@lo:400:kworker.0 Request processed in 36us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044138.403042:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784044138.403068:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598729088:0@lo:400:kworker.0 00000100:00100000:1.0:1784044138.403535:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3290:x1870705598728576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5025us (5269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044138.403556:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1784044138.403985:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044138.403990:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044138.405953:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598729216 00000100:00100000:3.0:1784044138.405967:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598729216 00000100:00100000:3.0:1784044138.406041:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784044138.406052:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3291:x1870705598729216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044138.406159:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3291:x1870705598729216:12345-0@lo:400:kworker.0 Request processed in 109us (3532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044138.406167:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1784044138.406190:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044138.406224:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598729216:0@lo:400:kworker.0 00000100:00100000:2.0:1784044138.407103:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598728576:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1784044138.653565:0:11996:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044138.653575:0:11996:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044138.653625:0:11996:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1784044138.653632:0:11996:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784044138.816633:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044138.817480:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582993280 00000100:00100000:3.0:1784044138.817492:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582993280 00000100:00100000:3.0:1784044138.817557:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:3.0:1784044138.817568:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:10552:x1870705582993280:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044138.817592:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044138.817610:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a755095e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead82a expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044138.817699:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a7550965 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044138.817724:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a7550965 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044138.817735:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a7550965 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044138.817747:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784044138.818456:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a755095e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead82a expref: 27 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044138.818475:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a7550965 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead82a expref: 26 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044138.818483:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044138.818486:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784044138.818489:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b000, rc 0) 00000100:00100000:3.0:1784044138.818553:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:10552:x1870705582993280:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 987us (1928us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1784044138.818563:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:2.0:1784044138.825092:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044138.825142:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582993408 00000100:00100000:2.0:1784044138.825152:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582993408 00000100:00100000:2.0:1784044138.825204:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:2.0:1784044138.825215:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:10552:x1870705582993408:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:2.0:1784044138.825281:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550973 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044138.825299:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044138.825310:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044138.825340:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044138.825347:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550973 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044138.825354:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044138.825372:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044138.825376:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044138.825384:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550973 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044138.825396:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:2.0:1784044138.825399:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044138.825405:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550973 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044138.825412:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550973 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044138.825477:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:10552:x1870705582993408:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 264us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044138.825485:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:0.0:1784044138.910899:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598729344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044138.910979:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044138.911448:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598729344 00000100:00100000:1.0:1784044138.911457:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598729344 00000100:00100000:1.0:1784044138.911511:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784044138.911523:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598729344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044138.911897:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044138.915832:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598729344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4301us (4843us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044138.915848:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784044138.915896:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598729344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044138.916045:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044138.916137:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582993536 00000100:00100000:1.0:1784044138.916144:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582993536 00000100:00100000:1.0:1784044138.916314:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:1.0:1784044138.916323:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582993536:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1784044138.916341:0:6571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044138.916365:0:6571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b0b7c39/0x9cc73983a755097a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead831 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784044138.916397:0:6571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a565a67, atime: 0x6a565a66, ctime: 0x6a565a67, blocks: 0xb 00010000:00010000:1.0:1784044138.916415:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:1.0:1784044138.916419:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044138.916428:0:6571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b0b7c39/0x9cc73983a755097a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead831 expref: 7 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044138.916447:0:6571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b0b7c39/0x9cc73983a755097a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead831 expref: 7 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044138.916460:0:6571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0030200, rc 0) 00000100:00100000:1.0:1784044138.916515:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705582993536:12345-192.168.204.50@tcp:101:cat.0 Request processed in 193us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044138.916522:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:1.0:1784044138.920067:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044138.920127:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582993664 00000100:00100000:1.0:1784044138.920150:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582993664 00002000:00100000:1.0:1784044138.920263:0:6577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff904bc5fc9180 x1870705582993664/t0(0) o3->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:289/0 lens 488/0 e 0 to 0 dl 1784044149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784044138.920275:0:6577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bc5fc9180 with x1870705582993664 ext(0->4095) 00002000:00010000:1.0:1784044138.920281:0:6577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904bc5fc9180 00000100:00100000:1.0:1784044138.920307:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1784044138.920316:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2345:x1870705582993664:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1784044138.920528:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2345:x1870705582993664:12345-192.168.204.50@tcp:3:cat.0 Request processed in 212us (470us total) trans 0 rc 4096/4096 00000100:00080000:3.0:1784044138.920655:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044138.920701:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00002000:00100000:1.0:1784044138.920709:0:6577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff904bc5fc9180 x1870705582993664/t0(0) o3->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:289/0 lens 488/4536 e 0 to 0 dl 1784044149 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784044138.920717:0:6577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bc5fc9180 with x1870705582993664 ext(0->4095) 00002000:00010000:1.0:1784044138.920720:0:6577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904bc5fc9180 00000001:00080000:2.0:1784044139.026666:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1784044139.026691:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:2.0:1784044139.359481:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044139.389004:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044139.389048:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044139.389089:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044139.389148:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582993920 00000100:00100000:2.0:1784044139.389159:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582993920 00000100:00100000:2.0:1784044139.389233:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:2.0:1784044139.389244:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:2346:x1870705582993920:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044139.389296:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582994176 00000100:00100000:3.0:1784044139.389302:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582994176 00000100:00100000:2.0:1784044139.389333:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:2346:x1870705582993920:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044139.389341:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:2.0:1784044139.389346:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:3.0:1784044139.389354:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582994176:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044139.389390:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582994176:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 38us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044139.389521:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00080000:0.0:1784044139.389608:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044139.389613:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044139.390271:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582993792 00000100:00100000:2.0:1784044139.390279:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582993792 00000100:00100000:1.0:1784044139.390296:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044139.390337:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044139.390365:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582994304 00000100:00100000:0.0:1784044139.390370:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582994304 00000100:00100000:0.0:1784044139.390436:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00100000:0.0:1784044139.390445:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582994304:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044139.390493:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582994304:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 50us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044139.390501:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00100000:3.0:1784044139.390900:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582994048 00000100:00100000:3.0:1784044139.390906:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582994048 00000100:00100000:3.0:1784044139.390966:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:3.0:1784044139.390975:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2346:x1870705582994048:12345-192.168.204.50@tcp:400:kworker.0 00000100:00080000:1.0:1784044139.390989:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044139.391033:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2346:x1870705582994048:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 59us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044139.391041:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:2.0:1784044139.391426:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 289 00000100:00100000:2.0:1784044139.391435:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705582993792:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044139.391465:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705582993792:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 32us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044139.391474:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 289 00010000:00010000:1.0:1784044140.389819:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784044141.040047:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000001:00080000:3.0:1784044141.040064:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1784044141.040082:0:5791:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff904bd41c2e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1784044141.040098:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bff9be000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff904bf58ad540 00000020:00080000:3.0:1784044141.040102:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bff9bea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff904bffbca000 00000020:00080000:3.0:1784044141.040125:0:5791:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1784044141.040130:0:5791:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000001:00080000:3.0:1784044141.040134:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1784044141.040178:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1784044141.040386:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1784044141.099939:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1784044141.100069:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1784044141.406606:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044142.174126:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044142.174137:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044142.174448:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1784044142.174464:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784044142.430160:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044143.454221:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044143.518458:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598729472:0@lo:400:kworker.0 00000100:00100000:1.0:1784044143.518535:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.518584:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc563d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598729984:0@lo:400:kworker.0 00000100:00100000:1.0:1784044143.518612:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.518637:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044143.518642:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc563f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598729856:0@lo:400:kworker.0 00000100:00100000:1.0:1784044143.518668:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.518697:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598729600:0@lo:400:kworker.0 00000100:00100000:1.0:1784044143.518719:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.518737:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc563ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598730112:0@lo:400:kworker.0 00000100:00100000:1.0:1784044143.518760:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.518779:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044143.518785:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598729728:0@lo:400:kworker.0 00000100:00100000:1.0:1784044143.518830:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.518899:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598729472 00000100:00100000:1.0:1784044143.518906:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598729472 00000100:00100000:1.0:1784044143.518948:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1784044143.518958:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598729472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044143.518972:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598729984 00000100:00100000:3.0:1784044143.518979:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598729984 00000100:00100000:1.0:1784044143.519014:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598729472:12345-0@lo:400:kworker.0 Request processed in 57us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044143.519022:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1784044143.519049:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598729600 00000100:00100000:3.0:1784044143.519053:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598729600 00000100:00100000:3.0:1784044143.519071:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598729728 00000100:00100000:3.0:1784044143.519073:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598729728 00000100:00100000:1.0:1784044143.519094:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784044143.519109:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598729984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044143.519140:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598729984:12345-0@lo:400:kworker.0 Request processed in 40us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044143.521597:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784044143.521624:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598729600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044143.521722:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598729600:12345-0@lo:400:kworker.0 Request processed in 113us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044143.521742:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784044143.521776:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784044143.521783:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598729728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044143.521811:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598729600:0@lo:400:kworker.0 00000100:00100000:3.0:1784044143.521818:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598729728:12345-0@lo:400:kworker.0 Request processed in 33us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044143.521824:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784044143.521848:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598729728:0@lo:400:kworker.0 00000100:00100000:0.0:1784044143.521916:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598729856 00000100:00100000:0.0:1784044143.521922:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598729856 00000100:00100000:0.0:1784044143.521964:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598730112 00000100:00100000:0.0:1784044143.521968:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598730112 00000100:00100000:0.0:1784044143.521989:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784044143.521997:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598729856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044143.522055:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598729856:12345-0@lo:400:kworker.0 Request processed in 40us (3366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044143.522063:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784044143.522075:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784044143.522091:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598730112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044143.522122:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598730112:12345-0@lo:400:kworker.0 Request processed in 41us (3362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044143.522127:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784044143.522153:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1784044143.522159:0:3290:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1784044143.522434:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904bf56c1500, transno 4294967304 00000100:00100000:0.0:1784044143.522449:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc563ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598730112:0@lo:400:kworker.0 00000100:00100000:3.0:1784044143.523943:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044143.523964:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598730240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044143.524051:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044143.524108:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598730240 00000100:00100000:3.0:1784044143.524115:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598730240 00000100:00100000:3.0:1784044143.524157:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784044143.524166:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598730240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044143.524196:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044143.524239:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598730240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044143.524245:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784044143.524293:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1784044143.524299:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904bed964000, transno 4294967311 00000100:00100000:1.0:1784044143.524307:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000004:00080000:3.0:1784044143.524313:0:3290:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1784044143.524342:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598730240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044143.524360:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc563f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598729856:0@lo:400:kworker.0 00000100:00100000:1.0:1784044143.524376:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598729472:0@lo:400:kworker.0 00000100:00080000:3.0:1784044143.524389:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044143.524391:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc563d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598729984:0@lo:400:kworker.0 00000100:00080000:3.0:1784044143.524395:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044143.524400:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044144.030191:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044144.030222:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598730368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044144.030316:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.030454:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598730368 00000100:00100000:2.0:1784044144.030462:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598730368 00000100:00100000:2.0:1784044144.030521:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784044144.030530:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598730368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044144.030566:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044144.030633:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598730368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.030640:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784044144.030889:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598730368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044144.141335:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044144.141420:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582994432 00000100:00100000:3.0:1784044144.141431:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582994432 00000100:00100000:3.0:1784044144.141511:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00100000:3.0:1784044144.141535:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:10197:x1870705582994432:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1784044144.141651:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:10197:x1870705582994432:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 Request processed in 130us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044144.141659:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00080000:1.0:1784044144.141981:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044144.150952:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044144.151087:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582994688 00000100:00100000:0.0:1784044144.151098:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582994688 00000100:00100000:0.0:1784044144.151160:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:0.0:1784044144.151170:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:10197:x1870705582994688:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784044144.151757:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:10197:x1870705582994688:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 587us (812us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1784044144.151773:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00010000:00010000:1.0:1784044144.479690:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044144.506693:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044144.506749:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044144.506784:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044144.506828:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044144.506988:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582995072 00000100:00100000:1.0:1784044144.506998:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582995072 00000100:00100000:3.0:1784044144.507122:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582994816 00000100:00100000:3.0:1784044144.507138:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582994816 00000100:00100000:3.0:1784044144.507189:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 291 00000100:00100000:3.0:1784044144.507199:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705582994816:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044144.507290:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705582994816:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 91us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044144.507299:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 291 00000100:00100000:1.0:1784044144.507421:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582994944 00000100:00100000:1.0:1784044144.507426:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582994944 00000100:00100000:3.0:1784044144.507452:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582995200 00000100:00100000:3.0:1784044144.507457:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582995200 00000100:00100000:0.0:1784044144.507505:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:0.0:1784044144.507516:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582995072:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044144.507555:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705582995072:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.507562:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00080000:2.0:1784044144.508066:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044144.508072:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044144.508074:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044144.508948:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:1.0:1784044144.508960:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705582994944:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044144.509016:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705582994944:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 60us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.509036:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:3.0:1784044144.509132:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 139 00000100:00100000:3.0:1784044144.509141:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582995200:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044144.509171:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705582995200:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 31us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044144.509177:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 139 00000100:00100000:3.0:1784044144.593168:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044144.593287:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582995328 00000100:00100000:0.0:1784044144.593300:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582995328 00000100:00100000:0.0:1784044144.593373:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 136 00000100:00100000:0.0:1784044144.593394:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:11004:x1870705582995328:12345-192.168.204.50@tcp:101:lsof.0 00010000:00010000:0.0:1784044144.593417:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044144.593438:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550981 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead838 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.593504:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.593518:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.593529:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044144.593721:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784044144.593726:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044144.593812:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.593848:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550981 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead838 expref: 7 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.593916:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead838 expref: 6 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.593926:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:0.0:1784044144.593929:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044144.593932:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7800, rc 0) 00000100:00100000:0.0:1784044144.593987:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:11004:x1870705582995328:12345-192.168.204.50@tcp:101:lsof.0 Request processed in 596us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.593995:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 136 00010000:00010000:2.0:1784044145.502164:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784044146.161531:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1784044146.161559:0:5791:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1784044146.161718:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1784044146.161732:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1784044146.526288:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044147.550196:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044148.576108:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044148.641038:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598730496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044148.641116:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044148.643619:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598730496 00000100:00100000:3.0:1784044148.643637:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598730496 00000100:00100000:3.0:1784044148.643703:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784044148.643725:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598730496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044148.643761:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044148.644156:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc563f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598730752:0@lo:400:kworker.0 00000100:00080000:2.0:1784044148.644932:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044148.645071:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc563d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598730624:0@lo:400:kworker.0 00000100:00100000:1.0:1784044148.645403:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044148.645456:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc563ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598730880:0@lo:400:kworker.0 00000100:00100000:1.0:1784044148.645490:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044148.645519:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044148.645526:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598731008:0@lo:400:kworker.0 00000100:00100000:1.0:1784044148.645548:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044148.645597:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598730752 00000100:00100000:1.0:1784044148.645605:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598730752 00000100:00100000:1.0:1784044148.645643:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598730880 00000100:00100000:1.0:1784044148.645646:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598730880 00000100:00100000:1.0:1784044148.645664:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598731008 00000100:00100000:1.0:1784044148.645667:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598731008 00000100:00100000:1.0:1784044148.645681:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784044148.645689:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598730752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044148.645736:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598730752:12345-0@lo:400:kworker.0 Request processed in 48us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044148.645743:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784044148.645761:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784044148.645767:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598730880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044148.645799:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598730880:12345-0@lo:400:kworker.0 Request processed in 33us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044148.645805:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784044148.645816:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784044148.645823:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598731008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044148.645850:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598731008:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044148.645855:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784044148.645913:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598731008:0@lo:400:kworker.0 00000100:00100000:1.0:1784044148.645935:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc563ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598730880:0@lo:400:kworker.0 00000100:00080000:1.0:1784044148.645968:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044148.645984:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc563f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598730752:0@lo:400:kworker.0 00000100:00100000:3.0:1784044148.647059:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598730496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3333us (5939us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044148.647071:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784044148.647132:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598730496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044148.648190:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044148.648237:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598731136:0@lo:400:kworker.0 00000100:00100000:2.0:1784044148.648278:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044148.648320:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598731136 00000100:00100000:2.0:1784044148.648325:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598731136 00000100:00100000:2.0:1784044148.648372:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784044148.648380:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598731136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044148.648428:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598731136:12345-0@lo:400:kworker.0 Request processed in 48us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044148.648436:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1784044148.648456:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044148.648480:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598731136:0@lo:400:kworker.0 00000100:00100000:3.0:1784044148.648736:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598730624 00000100:00100000:3.0:1784044148.648741:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598730624 00000100:00100000:3.0:1784044148.648821:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1784044148.648830:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598730624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044148.648898:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598730624:12345-0@lo:400:kworker.0 Request processed in 69us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044148.648904:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1784044148.652566:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc563d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598730624:0@lo:400:kworker.0 00000001:02000400:3.0:1784044148.714860:0:12199:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 11:49:07 (1784044147) 00000100:00100000:1.0:1784044149.150851:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598731264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044149.150959:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044149.151193:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598731264 00000100:00100000:2.0:1784044149.151202:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598731264 00000100:00100000:2.0:1784044149.151251:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784044149.151261:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598731264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044149.151296:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044149.151405:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598731264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044149.151414:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784044149.154504:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598731264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784044149.601100:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044149.633775:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044149.634195:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582995456 00000100:00100000:2.0:1784044149.634205:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582995456 00000100:00100000:2.0:1784044149.634280:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 293 00000100:00100000:2.0:1784044149.634290:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582995456:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044149.634364:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705582995456:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 76us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044149.634372:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 293 00000100:00100000:1.0:1784044149.637465:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044149.637563:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044149.637600:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044149.637719:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044149.640527:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582995968 00000100:00100000:3.0:1784044149.640541:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582995968 00000100:00100000:3.0:1784044149.640622:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582995584 00000100:00100000:3.0:1784044149.640626:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582995584 00000100:00100000:3.0:1784044149.640655:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 143 00000100:00100000:3.0:1784044149.640665:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:2347:x1870705582995968:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044149.640758:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:2347:x1870705582995968:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 94us (3194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044149.640766:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 143 00000100:00100000:3.0:1784044149.640784:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 144 00000100:00100000:3.0:1784044149.640804:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:2347:x1870705582995584:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044149.640840:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:2347:x1870705582995584:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 37us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044149.640846:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 144 00000100:00080000:3.0:1784044149.641045:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044149.644897:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582995712 00000100:00100000:0.0:1784044149.644912:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582995712 00000100:00100000:0.0:1784044149.644995:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582995840 00000100:00100000:0.0:1784044149.644999:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582995840 00000100:00100000:0.0:1784044149.645029:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:0.0:1784044149.645039:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582995712:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044149.645247:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582995712:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 209us (7803us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044149.645257:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:0.0:1784044149.645277:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:0.0:1784044149.645284:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582995840:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044149.645309:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705582995840:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 26us (7591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044149.645330:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00080000:3.0:1784044149.645830:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044149.645836:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044149.869166:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044149.869468:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582996224 00000100:00100000:1.0:1784044149.869479:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582996224 00000100:00100000:1.0:1784044149.869553:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 137 00000100:00100000:1.0:1784044149.869565:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:11269:x1870705582996224:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044149.869588:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044149.869610:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a755098f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead83f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.869697:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550996 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.869711:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550996 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.869723:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550996 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.869753:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a755099d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.869761:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a755099d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.869769:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a755099d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871129:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871146:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871156:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044149.871167:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1784044149.871415:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550996 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871423:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550996 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871430:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550996 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871437:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044149.871441:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550996 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871461:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550996 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871472:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff904bd19d5e00) 00010000:00010000:1.0:1784044149.871475:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044149.871480:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550996 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871486:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550996 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871511:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a755099d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871518:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a755099d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871524:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a755099d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871529:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044149.871532:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a755099d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871538:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a755099d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871546:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff904bc5fdbc00) 00010000:00010000:1.0:1784044149.871548:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044149.871551:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a755099d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.871566:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a755099d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.872784:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a755098f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead83f expref: 16 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.872850:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead83f expref: 15 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044149.872859:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:1.0:1784044149.872861:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044149.872889:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0030a00, rc 0) 00000100:00100000:1.0:1784044149.873027:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:11269:x1870705582996224:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 3462us (3868us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1784044149.873038:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 137 00000100:00100000:0.0:1784044149.878755:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044149.878853:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044149.878978:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582996352 00000100:00100000:1.0:1784044149.878999:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582996352 00000100:00100000:1.0:1784044149.879065:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 138 00000100:00100000:1.0:1784044149.879077:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:11269:x1870705582996352:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784044149.879189:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:11269:x1870705582996352:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 Request processed in 114us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044149.879197:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 138 00000100:00100000:2.0:1784044149.879634:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582996480 00000100:00100000:2.0:1784044149.879640:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582996480 00000100:00100000:2.0:1784044149.879693:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:2.0:1784044149.879701:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:2346:x1870705582996480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044149.879711:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044149.879733:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead83f expref: 15 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044149.879754:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:2.0:1784044149.879758:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044149.879778:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:2346:x1870705582996480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044149.879785:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000040:00080000:2.0:1784044150.372891:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044150.372901:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044150.373622:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1784044150.373633:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784044150.625201:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784044151.253835:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:1.0:1784044151.652602:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044151.756370:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044151.756449:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582996608 00000100:00100000:1.0:1784044151.756458:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582996608 00000100:00100000:1.0:1784044151.756562:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 139 00000100:00100000:1.0:1784044151.756584:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:11311:x1870705582996608:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044151.756604:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044151.756626:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75509b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead846 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.756692:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75509b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.756707:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75509b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.756717:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75509b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.756730:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.756737:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.756743:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784044151.757194:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784044151.757238:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75509b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757247:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75509b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757254:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75509b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757270:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044151.757274:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75509b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757282:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75509b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757296:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:1.0:1784044151.757299:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044151.757304:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75509b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757309:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a75509b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757323:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757329:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757335:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757340:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044151.757343:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757349:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757367:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff904bc5fdbc00) 00010000:00010000:1.0:1784044151.757369:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044151.757372:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757378:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757413:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75509b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead846 expref: 14 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757422:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:1.0:1784044151.757425:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044151.757428:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a75509b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead846 expref: 14 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.757438:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031800, rc 0) 00000100:00100000:1.0:1784044151.760979:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:11311:x1870705582996608:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4386us (4605us total) trans 0 rc 301/301 00000100:00100000:1.0:1784044151.760992:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 139 00000100:00100000:3.0:1784044151.769243:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044151.769319:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582996864 00000100:00100000:1.0:1784044151.769329:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582996864 00000100:00100000:1.0:1784044151.769387:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 140 00000100:00100000:1.0:1784044151.769398:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:11311:x1870705582996864:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:1.0:1784044151.769452:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044151.769480:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904c02177400/0x9cc73983a7550330 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead67f expref: 13 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.769510:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:1.0:1784044151.769516:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044151.769772:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.769786:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead838 expref: 5 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.769795:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.769827:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead838 expref: 5 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.769842:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead838 expref: 5 pid: 5769 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044151.769857:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598731392:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044151.771096:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044151.774769:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598731392:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044151.774799:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044151.779710:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044151.779803:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582996992 00000100:00100000:1.0:1784044151.779812:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582996992 00010000:00010000:1.0:1784044151.780173:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead838 expref: 6 pid: 5769 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044151.780216:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:1.0:1784044151.780227:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:2348:x1870705582996992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044151.780241:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044151.780255:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead838 expref: 6 pid: 5769 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.780268:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead838 expref: 6 pid: 5769 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.780290:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550988 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead838 expref: 6 pid: 5769 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.780305:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:1.0:1784044151.780311:0:8289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.780320:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.780328:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.780354:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044151.780406:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2348:x1870705582996992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 181us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044151.780414:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00010000:00010000:1.0:1784044151.780513:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.780521:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.780545:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.780565:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.780574:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044151.786163:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1784044151.786185:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.786196:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.786205:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.786211:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0030a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044151.786215:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.786223:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.786240:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbd00) 00010000:00010000:1.0:1784044151.786243:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044151.786247:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.786253:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044151.786294:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001dc8dfd0 reply state 00000000d757b169 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044151.786303:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044151.786988:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:11311:x1870705582996864:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 17586us (17749us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1784044151.786999:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 140 00000100:00080000:2.0:1784044151.787336:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784044151.794705:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.794724:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.794733:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.794741:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc0031200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044151.794746:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.794756:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.794773:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff904bc5fdbc00) 00010000:00010000:1.0:1784044151.794777:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044151.794782:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.794788:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509ce lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044151.894456:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044151.896810:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582997120 00000100:00100000:0.0:1784044151.896832:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582997120 00000100:00100000:1.0:1784044151.897028:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 141 00000100:00100000:1.0:1784044151.897041:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:11319:x1870705582997120:12345-192.168.204.50@tcp:101:lctl.0 00010000:00010000:1.0:1784044151.897065:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044151.897099:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead84d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.897162:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.897189:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.897200:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044151.897261:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784044151.897265:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044151.897290:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.897314:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a75509d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead84d expref: 15 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.897338:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead84d expref: 14 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044151.897347:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:1.0:1784044151.897363:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044151.897366:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0030a00, rc 0) 00000100:00100000:1.0:1784044151.897461:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:11319:x1870705582997120:12345-192.168.204.50@tcp:101:lctl.0 Request processed in 421us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044151.897469:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 141 00000100:00100000:1.0:1784044151.967592:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044151.973431:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582997248 00000100:00100000:3.0:1784044151.973446:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582997248 00000100:00100000:3.0:1784044151.973530:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 142 00000100:00100000:3.0:1784044151.973541:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:11325:x1870705582997248:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1784044151.973575:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044151.973599:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75509e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead854 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.973673:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75509ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974009:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75509ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974039:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75509ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974062:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75509f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974071:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75509f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974079:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75509f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974373:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75509f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974383:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75509f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974391:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75509f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044151.974427:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1784044151.974431:0:7482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044151.974453:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75509f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974465:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75509ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974539:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75509ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974557:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75509ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974627:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9bc00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044151.974632:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75509ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974641:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75509ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974654:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:3.0:1784044151.974657:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044151.974661:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75509ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974669:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a75509ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974859:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75509f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974976:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75509f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974983:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75509f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.974989:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044151.974993:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75509f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.975010:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75509f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.975019:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff904bc7c1e800) 00010000:00010000:3.0:1784044151.975022:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044151.975025:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75509f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.975031:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a75509f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.975067:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75509e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead854 expref: 16 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.975081:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75509f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead854 expref: 15 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.975089:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044151.975092:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784044151.975094:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b200, rc 0) 00000100:00100000:3.0:1784044151.975179:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:11325:x1870705582997248:12345-192.168.204.50@tcp:101:bash.0 Request processed in 1639us (7595us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044151.975188:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 142 00000100:00100000:2.0:1784044151.986989:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044151.987111:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582997504 00000100:00100000:3.0:1784044151.987121:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582997504 00000100:00100000:3.0:1784044151.987190:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 143 00000100:00100000:3.0:1784044151.987201:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+15:11325:x1870705582997504:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1784044151.987239:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044151.987258:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75509ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead85b expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.987405:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.987420:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.987431:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.987498:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.987511:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.987518:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784044151.988118:0:5771:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1784044151.988275:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988286:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988294:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988341:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988348:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a06 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988354:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988360:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044151.988365:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988372:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988384:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044151.988388:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044151.988393:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a06 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988399:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a06 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044151.988425:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b5ff4ad reply state 000000001a40eafe transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044151.988434:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784044151.988466:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a75509ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead85b expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988491:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead85b expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.988499:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044151.988501:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044151.988504:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a400, rc 0) 00000100:00100000:3.0:1784044151.988579:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:11325:x1870705582997504:12345-192.168.204.50@tcp:101:bash.0 Request processed in 1379us (1598us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1784044151.988587:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 143 00010000:00010000:3.0:1784044151.994417:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.994436:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.994443:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.994449:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9bc00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044151.994453:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.994461:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.995118:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bc7c1e800) 00010000:00010000:3.0:1784044151.995124:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044151.995129:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044151.995152:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550a0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044151.995795:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044151.995912:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582997632 00000100:00100000:0.0:1784044151.995920:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582997632 00000100:00100000:0.0:1784044151.995998:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:0.0:1784044151.996009:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2348:x1870705582997632:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044151.996026:0:6571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044151.996046:0:6571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d8135c3/0x9cc73983a7550a22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead862 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044151.996072:0:6571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044151.996092:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1784044151.996096:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044151.996106:0:6571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d8135c3/0x9cc73983a7550a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead862 expref: 6 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044151.996125:0:6571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d8135c3/0x9cc73983a7550a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead862 expref: 6 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044151.996138:0:6571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6a00, rc 0) 00000100:00100000:0.0:1784044151.996206:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705582997632:12345-192.168.204.50@tcp:101:bash.0 Request processed in 198us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044151.996222:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00080000:2.0:1784044151.997034:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044152.006497:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044152.006670:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582997760 00000100:00100000:0.0:1784044152.006680:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582997760 00000100:00100000:0.0:1784044152.006852:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:0.0:1784044152.006905:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:11325:x1870705582997760:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044152.006925:0:11907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044152.006960:0:11907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead869 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.006996:0:11907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d8135c3/0x9cc73983a7550a22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead862 expref: 7 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.007005:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044152.007010:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044152.007016:0:11907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 7 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.007053:0:11907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d8135c3/0x9cc73983a7550a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead862 expref: 7 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.007067:0:11907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d8135c3/0x9cc73983a7550a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead862 expref: 7 pid: 6571 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044152.007083:0:11907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11907:1870705598731520:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044152.007239:0:11907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044152.017909:0:11907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11907:1870705598731520:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044152.017956:0:11907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 7 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.017976:0:11907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7a00, rc 0) 00000100:00100000:0.0:1784044152.018030:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:11325:x1870705582997760:12345-192.168.204.50@tcp:101:bash.0 Request processed in 11169us (11545us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044152.018038:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1784044152.019018:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044152.020673:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582997888 00000100:00100000:3.0:1784044152.020686:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582997888 00010000:00010000:0.0:1784044152.020901:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d8135c3/0x9cc73983a7550a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead862 expref: 7 pid: 6571 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044152.021004:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:0.0:1784044152.021015:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705582997888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044152.021030:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044152.021055:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000004d8135c3/0x9cc73983a7550a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead862 expref: 7 pid: 6571 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.021071:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d8135c3/0x9cc73983a7550a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead862 expref: 7 pid: 6571 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.021096:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d8135c3/0x9cc73983a7550a22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead862 expref: 7 pid: 6571 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.021112:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784044152.021117:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044152.021152:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 6 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.021171:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 6 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.021213:0:5755:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 6 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044152.021228:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5755:1870705598731648:192.168.204.50@tcp:105: 00000100:00100000:0.0:1784044152.021615:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044152.024853:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5755:1870705598731648:192.168.204.50@tcp:105: 00010000:00010000:0.0:1784044152.024907:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044152.025087:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2347:x1870705582997888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4072us (6366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044152.025099:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:3.0:1784044152.030831:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044152.031145:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582998144 00000100:00100000:1.0:1784044152.031155:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582998144 00000100:00100000:1.0:1784044152.031491:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:1.0:1784044152.031503:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:11325:x1870705582998144:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:1.0:1784044152.032034:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:11325:x1870705582998144:12345-192.168.204.50@tcp:35:bash.0 Request processed in 532us (1210us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1784044152.032042:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:2.0:1784044152.154232:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044152.155149:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582998400 00000100:00100000:1.0:1784044152.155162:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582998400 00000100:00100000:1.0:1784044152.155236:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 144 00000100:00100000:1.0:1784044152.155247:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:11335:x1870705582998400:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044152.155274:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044152.155294:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550a30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead870 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044152.155418:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1784044152.155528:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550a30 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead870 expref: 20 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.155562:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:1.0:1784044152.155565:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044152.155570:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550a30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead870 expref: 20 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.155588:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031200, rc 0) 00000100:00100000:1.0:1784044152.155661:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:11335:x1870705582998400:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 415us (1438us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1784044152.155668:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 144 00000100:00100000:1.0:1784044152.159382:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044152.162147:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582998656 00000100:00100000:0.0:1784044152.162161:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582998656 00000100:00100000:0.0:1784044152.162232:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:0.0:1784044152.162243:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:11335:x1870705582998656:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044152.162523:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:11335:x1870705582998656:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 281us (3150us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1784044152.162532:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:2.0:1784044152.295522:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044152.295789:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582998784 00000100:00100000:3.0:1784044152.295799:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582998784 00000100:00100000:3.0:1784044152.295857:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 145 00000100:00100000:3.0:1784044152.295919:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:11341:x1870705582998784:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044152.296042:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044152.296066:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead877 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.296434:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550a45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.296450:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.296463:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044152.296519:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1784044152.296523:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044152.296545:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.296570:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead877 expref: 22 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.296609:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550a45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead877 expref: 21 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.296617:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044152.296620:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044152.296623:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9be00, rc 0) 00000100:00100000:3.0:1784044152.299892:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:11341:x1870705582998784:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3941us (4345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044152.299907:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 145 00000100:00100000:2.0:1784044152.326215:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044152.326407:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582999040 00000100:00100000:1.0:1784044152.326418:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582999040 00000100:00100000:1.0:1784044152.326584:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 146 00000100:00100000:1.0:1784044152.326596:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:11341:x1870705582999040:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044152.326617:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044152.326650:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550a4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead87e expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.327121:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550a53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.327137:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.327148:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044152.327177:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784044152.327316:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031200/0x9cc73983a7550a4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead87e expref: 24 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.327338:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead87e expref: 23 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.327347:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:1.0:1784044152.327349:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044152.327353:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc0031800, rc 0) 00000100:00100000:1.0:1784044152.327581:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:11341:x1870705582999040:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 986us (1374us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1784044152.327593:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 146 00000100:00100000:0.0:1784044152.334750:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044152.334933:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582999296 00000100:00100000:1.0:1784044152.334947:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582999296 00000100:00100000:1.0:1784044152.335131:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 147 00000100:00100000:1.0:1784044152.335143:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:11341:x1870705582999296:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044152.335168:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044152.335188:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550a61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead885 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.335512:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550a68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.335529:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.335557:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044152.335571:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784044152.335702:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031000/0x9cc73983a7550a61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead885 expref: 26 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.336074:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550a68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead885 expref: 25 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.336086:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:1.0:1784044152.336089:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784044152.336831:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663600, rc 0) 00000100:00100000:3.0:1784044152.337170:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+25:11341:x1870705582999296:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2026us (2440us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1784044152.337178:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 147 00000100:00100000:3.0:1784044152.337373:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044152.337699:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582999424 00000100:00100000:3.0:1784044152.337707:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582999424 00000100:00100000:3.0:1784044152.338243:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:3.0:1784044152.338331:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+25:2348:x1870705582999424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044152.338346:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044152.338367:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031800/0x9cc73983a7550a53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead87e expref: 25 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.338387:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044152.338390:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044152.338430:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:2348:x1870705582999424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044152.338452:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:3.0:1784044152.363782:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044152.369938:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582999552 00000100:00100000:1.0:1784044152.369955:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582999552 00000100:00100000:1.0:1784044152.370030:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:1.0:1784044152.370041:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705582999552:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1784044152.370085:0:6569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.370116:0:6569:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 6 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.370125:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044152.370129:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044152.370133:0:6569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.370187:0:6569:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 6 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.370202:0:6569:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 6 pid: 11907 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044152.370218:0:6569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6569:1870705598731776:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044152.370324:0:6569:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044152.380800:0:6569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6569:1870705598731776:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044152.380846:0:6569:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044152.384313:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044152.391693:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582999680 00000100:00100000:2.0:1784044152.391709:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582999680 00002000:00100000:2.0:1784044152.391769:0:6576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff904bff552d80 x1870705582999680/t0(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:303/0 lens 504/0 e 0 to 0 dl 1784044163 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044152.391779:0:6576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bff552d80 with x1870705582999680 ext(0->12) 00010000:00010000:2.0:1784044152.391787:0:6576:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 7 pid: 11907 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.391804:0:6576:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 7 pid: 11907 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044152.391812:0:6576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff904bff552d80 00000100:00100000:2.0:1784044152.391851:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:2.0:1784044152.391862:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705582999680:12345-192.168.204.50@tcp:4:lfs.0 00000100:00100000:2.0:1784044152.392739:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2347:x1870705582999680:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 875us (8495us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784044152.392748:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00002000:00100000:2.0:1784044152.392756:0:6576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff904bff552d80 x1870705582999680/t4294967305(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:303/0 lens 504/448 e 0 to 0 dl 1784044163 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044152.392772:0:6576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bff552d80 with x1870705582999680 ext(0->12) 00010000:00010000:2.0:1784044152.392779:0:6576:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 9 pid: 11907 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.392792:0:6576:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 9 pid: 11907 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044152.392799:0:6576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff904bff552d80 00000100:00100000:1.0:1784044152.396626:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044152.399616:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705582999808 00000100:00100000:2.0:1784044152.399630:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705582999808 00010000:00010000:2.0:1784044152.399698:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 9 pid: 11907 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044152.399748:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:2.0:1784044152.399758:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2345:x1870705582999808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044152.399775:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784044152.399794:0:5756:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784044152.399797:0:5756:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784044152 00002000:00010000:2.0:1784044152.399800:0:5756:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784044152 00002000:00010000:2.0:1784044152.399802:0:5756:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1784044152 00010000:00010000:2.0:1784044152.399807:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 9 pid: 11907 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.399821:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 9 pid: 11907 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.399898:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016c11dba/0x9cc73983a7550a29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead869 expref: 9 pid: 11907 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.399923:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044152.399928:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044152.399934:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.399945:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.400240:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044152.400358:0:6569:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.400368:0:6569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.400395:0:6569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.400403:0:6569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.400410:0:6569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.400417:0:6569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044152.400429:0:6569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044152.400430:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2345:x1870705582999808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 673us (3814us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044152.400438:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00010000:00010000:1.0:1784044152.400440:0:6569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.400451:0:6569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.400458:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a7550a76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044152.400509:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2345:x1870705582999552:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 30470us (36738us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044152.408451:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:2.0:1784044152.410638:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044152.410732:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583000064 00000100:00100000:1.0:1784044152.410743:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583000064 00000100:00100000:1.0:1784044152.410832:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:1.0:1784044152.410847:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfec9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:11341:x1870705583000064:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:1.0:1784044152.410956:0:5772:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550a68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead885 expref: 24 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784044152.411319:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1784044152.411365:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1784044152.411891:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1784044152.411950:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.411976:0:5772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead85b expref: 28 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.411986:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.412021:0:5772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead85b expref: 28 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.412037:0:5772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead85b expref: 28 pid: 5771 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044152.412051:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc563d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5772:1870705598731904:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044152.412137:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50773c0 going to sleep for 11 seconds 00000040:00080000:0.0:1784044152.418626:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044152.418636:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044152.418851:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1784044152.418860:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784044152.424163:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044152.424282:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc563d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5772:1870705598731904:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044152.424318:0:5772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044152.424528:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583000192 00000100:00100000:0.0:1784044152.424536:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583000192 00010000:00010000:0.0:1784044152.424593:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead85b expref: 29 pid: 5771 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044152.424629:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:0.0:1784044152.424639:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:2348:x1870705583000192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044152.424653:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044152.424659:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead85b expref: 29 pid: 5771 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.424670:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead85b expref: 29 pid: 5771 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.424691:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550a14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead85b expref: 29 pid: 5771 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.424707:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044152.424711:0:8289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.424720:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.424728:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.425109:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044152.425187:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:2348:x1870705583000192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 548us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044152.425194:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00010000:00010000:1.0:1784044152.426842:0:5772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.426858:0:5772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044152.427355:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1784044152.427582:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1784044152.427697:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1870705598732032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784044152.428072:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044152.428110:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044152.429605:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598732032 00000100:00100000:2.0:1784044152.429616:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598732032 00000100:00100000:2.0:1784044152.429694:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784044152.429704:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5772:x1870705598732032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1784044152.429805:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044152.430410:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5772:x1870705598732032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 705us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044152.430419:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784044152.430814:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1870705598732032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784044152.432165:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1784044152.432256:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff550000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1870705598732160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784044152.432487:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044152.432662:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7c53900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044152.434163:0:11851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598732160 00000100:00100000:2.0:1784044152.434175:0:11851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598732160 00000100:00100000:3.0:1784044152.434483:0:11851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044152.434494:0:11851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5772:x1870705598732160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784044152.434809:0:11851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5772:x1870705598732160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 317us (2321us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784044152.434818:0:11851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784044152.434854:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff550000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1870705598732160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784044152.434945:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1784044152.434981:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.434989:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.434995:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.434998:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044152.438160:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.438180:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.438198:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044152.438202:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784044152.438207:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044152.438236:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550a7d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784044152.438672:0:5772:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784044152.439050:0:5772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1784044152.439062:0:5772:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330424197297ns, next at 331424194592ns, rc = 0 00000001:00080000:0.0:1784044152.439072:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1784044152.439128:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044152.439131:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784044152.439141:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550a68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead885 expref: 32 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044152.439343:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfec9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:11341:x1870705583000064:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 28498us (28713us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1784044152.439353:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000020:00080000:0.0:1784044152.439359:0:5772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784044152.445449:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044152.445538:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583000320 00000100:00100000:2.0:1784044152.445556:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583000320 00000100:00100000:2.0:1784044152.445618:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 148 00000100:00100000:2.0:1784044152.445629:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:11341:x1870705583000320:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1784044152.445654:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044152.445683:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550a84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead88c expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.445760:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550a84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead88c expref: 32 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.445774:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550a84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead88c expref: 32 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.445793:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:2.0:1784044152.445797:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044152.445800:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4000, rc 0) 00000100:00100000:2.0:1784044152.445854:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:11341:x1870705583000320:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 227us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044152.445894:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 148 00000100:00100000:2.0:1784044152.450211:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044152.450404:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583000576 00000100:00100000:1.0:1784044152.450414:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583000576 00000100:00100000:1.0:1784044152.450471:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:1.0:1784044152.450480:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:11341:x1870705583000576:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1784044152.450801:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+33:11341:x1870705583000576:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 320us (597us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1784044152.450809:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:0.0:1784044152.562523:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044152.566192:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583000832 00000100:00100000:3.0:1784044152.566206:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583000832 00000100:00100000:3.0:1784044152.566287:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 149 00000100:00100000:3.0:1784044152.566299:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+33:11351:x1870705583000832:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044152.566323:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044152.566343:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550a8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead893 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044152.566667:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784044152.566786:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550a8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead893 expref: 35 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.566802:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:3.0:1784044152.566805:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044152.566809:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550a8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead893 expref: 35 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.566824:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a800, rc 0) 00000100:00100000:3.0:1784044152.568425:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:11351:x1870705583000832:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2120us (5903us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1784044152.568438:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 149 00000100:00100000:3.0:1784044152.571504:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044152.571690:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583000960 00000100:00100000:2.0:1784044152.571700:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583000960 00000100:00100000:2.0:1784044152.571755:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 150 00000100:00100000:2.0:1784044152.571766:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:11351:x1870705583000960:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:2.0:1784044152.571837:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550a99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.571904:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.571926:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.571950:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.571957:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.571963:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572080:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572341:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572351:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044152.572404:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572417:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572424:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550a99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572441:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572446:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044152.572450:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572456:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550a99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572468:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:2.0:1784044152.572471:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044152.572475:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550a99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572482:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550a99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572495:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572501:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572506:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572512:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044152.572515:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572530:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572538:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bd19d5b00) 00010000:00010000:2.0:1784044152.572541:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044152.572544:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550aa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572550:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572563:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572570:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572575:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572581:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044152.572583:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572589:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572596:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:2.0:1784044152.572598:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044152.572600:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.572616:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550aa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044152.572747:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:11351:x1870705583000960:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 981us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044152.572755:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 150 00000100:00100000:1.0:1784044152.579010:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044152.579127:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583001216 00000100:00100000:0.0:1784044152.579137:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583001216 00000100:00100000:0.0:1784044152.579191:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:0.0:1784044152.579202:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:11351:x1870705583001216:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044152.579495:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:11351:x1870705583001216:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 294us (494us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1784044152.579502:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00010000:00010000:2.0:1784044152.670079:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044152.676421:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044152.676555:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583001472 00000100:00100000:1.0:1784044152.676566:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583001472 00000100:00100000:1.0:1784044152.676685:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 151 00000100:00100000:1.0:1784044152.676698:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:11354:x1870705583001472:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044152.676723:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044152.676754:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550aae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead89a expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.676842:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550ab5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.676856:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.676897:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.676913:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550abc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.676921:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.676928:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677112:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677122:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677129:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044152.677139:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784044152.677232:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677240:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550ab5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677247:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550ab5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677267:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044152.677271:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550ab5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677279:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550ab5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677292:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:1.0:1784044152.677295:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044152.677300:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550ab5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677316:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663600/0x9cc73983a7550ab5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677334:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677340:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550abc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677347:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677352:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044152.677355:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677361:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550abc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677371:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bc5fdbd00) 00010000:00010000:1.0:1784044152.677373:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044152.677376:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550abc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677383:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a7550abc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677424:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663800/0x9cc73983a7550aae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead89a expref: 38 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677440:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead89a expref: 37 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.677454:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:1.0:1784044152.677457:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044152.677460:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fd800, rc 0) 00000100:00100000:1.0:1784044152.677538:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:11354:x1870705583001472:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 842us (1517us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1784044152.677545:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 151 00000100:00100000:3.0:1784044152.690257:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044152.690370:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583001600 00000100:00100000:1.0:1784044152.690380:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583001600 00000100:00100000:1.0:1784044152.690554:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 152 00000100:00100000:1.0:1784044152.690566:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:11354:x1870705583001600:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1784044152.690632:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550ad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.690650:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.690661:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.690686:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.690693:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.690701:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.690708:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044152.690725:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.690733:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.690745:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:1.0:1784044152.690748:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044152.690752:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550ad1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044152.690758:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550ad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044152.690836:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:11354:x1870705583001600:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 272us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044152.690844:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 152 00000100:00100000:2.0:1784044152.697834:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044152.697990:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583001856 00000100:00100000:0.0:1784044152.698012:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583001856 00000100:00100000:0.0:1784044152.698366:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:0.0:1784044152.698378:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:11354:x1870705583001856:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044152.698657:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+38:11354:x1870705583001856:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 280us (831us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1784044152.698665:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:0.0:1784044152.934975:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044152.935080:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583002112 00000100:00100000:3.0:1784044152.935090:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583002112 00000100:00100000:3.0:1784044152.935200:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 153 00000100:00100000:3.0:1784044152.935210:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+38:11385:x1870705583002112:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1784044152.935234:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044152.935253:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550ad8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8a1 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.935352:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.935367:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.935390:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044152.935416:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784044152.935539:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550ad8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a1 expref: 41 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.935558:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a1 expref: 40 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044152.935582:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:3.0:1784044152.935585:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044152.935588:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9ac00, rc 0) 00000100:00100000:3.0:1784044152.935668:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:11385:x1870705583002112:12345-192.168.204.50@tcp:101:cat.0 Request processed in 451us (695us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1784044152.935677:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 153 00000100:00100000:0.0:1784044152.944052:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044152.944153:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044152.946149:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583002496 00000100:00100000:3.0:1784044152.946174:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583002496 00000100:00100000:3.0:1784044152.946230:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:3.0:1784044152.946241:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:11385:x1870705583002496:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1784044152.946544:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:11385:x1870705583002496:12345-192.168.204.50@tcp:35:cat.0 Request processed in 303us (2389us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1784044152.946552:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:2.0:1784044152.948312:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583002240 00000100:00100000:2.0:1784044152.948325:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583002240 00000100:00100000:2.0:1784044152.948394:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:2.0:1784044152.948404:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:2348:x1870705583002240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044152.948419:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044152.948443:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a1 expref: 41 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044152.948462:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:2.0:1784044152.948466:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044152.950673:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:2348:x1870705583002240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2259us (6618us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044152.950686:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1784044153.046065:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044153.049169:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583002752 00000100:00100000:2.0:1784044153.049186:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583002752 00000100:00100000:2.0:1784044153.051953:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 154 00000100:00100000:2.0:1784044153.051970:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:11391:x1870705583002752:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1784044153.051994:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044153.052011:0:7482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784044153.052041:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550a45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead877 expref: 40 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044153.052064:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:2.0:1784044153.052068:0:7482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044153.052084:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550aed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8a8 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044153.052187:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044153.052201:0:7482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead89a expref: 40 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044153.052209:0:7482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044153.052242:0:7482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead89a expref: 40 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044153.052255:0:7482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead89a expref: 40 pid: 5770 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044153.052268:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598732288:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044153.052676:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb39c540 going to sleep for 11 seconds 00000100:00080000:3.0:1784044153.055711:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044153.056640:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044153.056837:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583002880 00000100:00100000:0.0:1784044153.056846:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583002880 00010000:00010000:0.0:1784044153.056913:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead89a expref: 41 pid: 5770 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044153.056953:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:0.0:1784044153.056965:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:2347:x1870705583002880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044153.056980:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044153.056986:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead89a expref: 41 pid: 5770 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044153.057000:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead89a expref: 41 pid: 5770 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044153.057021:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:0.0:1784044153.057026:0:5757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044153.057054:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044153.057062:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044153.057081:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044153.057130:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:2347:x1870705583002880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 167us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044153.057139:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00010000:00010000:2.0:1784044153.058203:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7550ac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead89a expref: 40 pid: 5770 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044153.058245:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598732288:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044153.058265:0:7482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044153.058276:0:7482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044153.058282:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044153.058314:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784044153.060637:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550aed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a8 expref: 41 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044153.060662:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a8 expref: 40 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044153.060671:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:2.0:1784044153.060674:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784044153.060678:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4a00, rc 0) 00000100:00100000:2.0:1784044153.061711:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:11391:x1870705583002752:12345-192.168.204.50@tcp:101:dd.0 Request processed in 9738us (15648us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1784044153.062008:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 154 00000100:00100000:3.0:1784044153.073106:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044153.073705:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583003136 00000100:00100000:1.0:1784044153.073727:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583003136 00000100:00100000:1.0:1784044153.073791:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 155 00000100:00100000:1.0:1784044153.073801:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:11391:x1870705583003136:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:1.0:1784044153.074122:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.074139:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.074150:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784044153.074205:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1784044153.074245:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2ba70e4 reply state 00000000ae35df3a transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044153.074255:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044153.074345:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+43:11391:x1870705583003136:12345-192.168.204.50@tcp:36:dd.0 Request processed in 545us (1249us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1784044153.074352:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 155 00000020:00080000:1.0:1784044153.074357:0:5770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784044153.078594:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.078612:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.078618:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.078624:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044153.078628:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.078636:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.078652:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:1.0:1784044153.078655:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044153.078660:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.078666:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044153.440999:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044153.441151:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583003264 00000100:00100000:1.0:1784044153.441181:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583003264 00000100:00100000:1.0:1784044153.441263:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 156 00000100:00100000:1.0:1784044153.441275:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+42:11405:x1870705583003264:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:1.0:1784044153.441318:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044153.441346:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8af expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.441708:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7550b10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.441726:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7550b10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.441740:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7550b10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.441758:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7550b17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.441766:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7550b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.441773:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7550b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.441969:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.441982:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a8 expref: 43 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.441991:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.442041:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a8 expref: 43 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.442058:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a8 expref: 43 pid: 7482 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044153.442074:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc563f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598732416:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044153.442266:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044153.445936:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044153.446159:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583003520 00000100:00100000:3.0:1784044153.446170:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583003520 00000100:00100000:3.0:1784044153.446256:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:3.0:1784044153.446267:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+44:5565:x1870705583003520:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784044153.446603:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+45:5565:x1870705583003520:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 337us (676us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1784044153.446611:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:1.0:1784044153.448615:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc563f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598732416:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044153.448651:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044153.449762:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044153.461585:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583003648 00000100:00100000:1.0:1784044153.461600:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583003648 00010000:00010000:1.0:1784044153.461653:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a8 expref: 45 pid: 7482 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044153.461706:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:1.0:1784044153.461716:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+45:2347:x1870705583003648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044153.461732:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044153.461740:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a8 expref: 45 pid: 7482 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.461752:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a8 expref: 45 pid: 7482 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.461798:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7550af4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8a8 expref: 45 pid: 7482 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.461816:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:1.0:1784044153.461822:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.461832:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.461840:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.461926:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044153.463489:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+44:2347:x1870705583003648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1763us (13722us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044153.463503:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00010000:00010000:3.0:1784044153.464574:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464589:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044153.464639:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784044153.464643:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044153.464670:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464687:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464696:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7550b10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464702:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7550b10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464709:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7550b10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464715:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044153.464719:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7550b10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464744:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7550b10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464758:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044153.464761:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044153.464765:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7550b10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464772:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7550b10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464790:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7550b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464795:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7550b17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464801:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7550b17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464805:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fce00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044153.464807:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7550b17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464812:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7550b17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464818:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bc5fdbd00) 00010000:00010000:3.0:1784044153.464820:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044153.464822:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7550b17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464838:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7550b17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464938:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7550b09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8af expref: 44 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464955:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8af expref: 43 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.464963:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:3.0:1784044153.464965:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044153.464968:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fd000, rc 0) 00000100:00100000:3.0:1784044153.465030:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+43:11405:x1870705583003264:12345-192.168.204.50@tcp:101:stat.0 Request processed in 23756us (24044us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044153.465039:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 156 00000100:00100000:0.0:1784044153.636453:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044153.636696:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583003904 00000100:00100000:1.0:1784044153.636707:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583003904 00000100:00100000:1.0:1784044153.636770:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 157 00000100:00100000:1.0:1784044153.636779:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+43:11411:x1870705583003904:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:1.0:1784044153.636836:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044153.636919:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8af expref: 43 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.636945:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:1.0:1784044153.636950:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044153.637418:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.637433:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.637443:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784044153.637497:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1784044153.637520:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b802b67 reply state 00000000b07b8789 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044153.637528:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044153.637959:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+45:11411:x1870705583003904:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 1178us (1513us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1784044153.637978:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 157 00000020:00080000:1.0:1784044153.637984:0:5770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784044153.645773:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.645792:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.645799:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.645806:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fca00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044153.645810:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.645818:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.645889:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:3.0:1784044153.645893:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044153.645898:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.645905:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7550b25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.695016:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044153.759309:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598732544:0@lo:400:kworker.0 00000100:00100000:0.0:1784044153.759398:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044153.759417:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598732672:0@lo:400:kworker.0 00000100:00100000:0.0:1784044153.759457:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598733056:0@lo:400:kworker.0 00000100:00100000:2.0:1784044153.759465:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044153.759493:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598733184:0@lo:400:kworker.0 00000100:00100000:0.0:1784044153.759496:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044153.759537:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598732800:0@lo:400:kworker.0 00000100:00100000:2.0:1784044153.759545:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044153.759575:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044153.759587:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598733184 00000100:00100000:2.0:1784044153.759595:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598733184 00000100:00100000:0.0:1784044153.759601:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044153.759610:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598732928:0@lo:400:kworker.0 00000100:00100000:0.0:1784044153.759633:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044153.759669:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598732544 00000100:00100000:0.0:1784044153.759673:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598732544 00000100:00100000:0.0:1784044153.759702:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1784044153.759710:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598732544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044153.759769:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598732544:12345-0@lo:400:kworker.0 Request processed in 58us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044153.759776:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1784044153.759965:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598732672 00000100:00100000:1.0:1784044153.759970:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598732672 00000100:00100000:1.0:1784044153.759998:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598733056 00000100:00100000:1.0:1784044153.760001:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598733056 00000100:00080000:1.0:1784044153.760018:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044153.760030:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598732800 00000100:00100000:1.0:1784044153.760032:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598732800 00000100:00080000:1.0:1784044153.760042:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044153.760053:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784044153.760059:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598732672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044153.760097:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598732672:12345-0@lo:400:kworker.0 Request processed in 38us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044153.760103:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784044153.760146:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598732672:0@lo:400:kworker.0 00000100:00100000:1.0:1784044153.760168:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784044153.760174:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598733056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044153.760203:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598733056:12345-0@lo:400:kworker.0 Request processed in 30us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044153.760208:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784044153.760220:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784044153.760225:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598732800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044153.763746:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598732800:12345-0@lo:400:kworker.0 Request processed in 3507us (4158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044153.763761:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784044153.763886:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598732544:0@lo:400:kworker.0 00000100:00100000:1.0:1784044153.763914:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598733056:0@lo:400:kworker.0 00000100:00100000:1.0:1784044153.763978:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598732800:0@lo:400:kworker.0 00000100:00100000:3.0:1784044153.764831:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044153.764856:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598733312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044153.764954:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044153.764997:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598733312 00000100:00100000:3.0:1784044153.765002:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598733312 00000100:00100000:3.0:1784044153.765061:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784044153.765070:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598733312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044153.765102:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044153.765156:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598733312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044153.765163:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1784044153.765181:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044153.765206:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598733312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044153.765834:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598732928 00000100:00100000:2.0:1784044153.765842:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598732928 00000100:00100000:2.0:1784044153.765921:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784044153.765931:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598733184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044153.765995:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598733184:12345-0@lo:400:kworker.0 Request processed in 65us (6454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044153.766002:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784044153.766011:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784044153.766022:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598732928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044153.766043:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598733184:0@lo:400:kworker.0 00000100:00100000:3.0:1784044153.766066:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598732928:12345-0@lo:400:kworker.0 Request processed in 46us (6431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044153.766073:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784044153.768546:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598732928:0@lo:400:kworker.0 00000100:00100000:0.0:1784044153.843978:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044153.845297:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583004032 00000100:00100000:1.0:1784044153.845311:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583004032 00000100:00100000:1.0:1784044153.845381:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 158 00000100:00100000:1.0:1784044153.845392:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+44:11426:x1870705583004032:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:1.0:1784044153.845416:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044153.845437:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8b6 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845502:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550b33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845530:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550b33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845543:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550b33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845558:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845565:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845571:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845676:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845683:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845690:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044153.845727:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1784044153.845731:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044153.845752:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845764:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845783:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550b33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845789:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550b33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845796:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550b33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845802:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fda00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044153.845807:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550b33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845815:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550b33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845828:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:1.0:1784044153.845831:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044153.845835:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550b33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845841:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550b33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845895:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845902:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845908:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845920:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fde00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044153.845923:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845928:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845936:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bc5fdb000) 00010000:00010000:1.0:1784044153.845938:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044153.845941:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845947:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.845994:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8b6 expref: 46 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.846007:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8b6 expref: 45 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044153.846013:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:1.0:1784044153.846015:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044153.846017:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fd400, rc 0) 00000100:00100000:1.0:1784044153.846086:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+45:11426:x1870705583004032:12345-192.168.204.50@tcp:101:stat.0 Request processed in 696us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044153.846094:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 158 00000100:00100000:0.0:1784044153.971216:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044153.971354:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583004288 00000100:00100000:3.0:1784044153.971364:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583004288 00000100:00100000:3.0:1784044153.971433:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 159 00000100:00100000:3.0:1784044153.971442:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+45:11436:x1870705583004288:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044153.971462:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044153.971482:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8bd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044153.971605:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784044153.971718:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550b48 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8bd expref: 47 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.971746:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:3.0:1784044153.971749:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044153.971754:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8bd expref: 47 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044153.971767:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b600, rc 0) 00000100:00100000:3.0:1784044153.972388:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+46:11436:x1870705583004288:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 944us (1179us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1784044153.972398:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 159 00000100:00100000:0.0:1784044153.981603:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044153.981680:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583004544 00000100:00100000:3.0:1784044153.981692:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583004544 00000100:00100000:3.0:1784044153.981764:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:3.0:1784044153.981776:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfec8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+46:11436:x1870705583004544:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1784044153.982113:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfec8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+47:11436:x1870705583004544:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 339us (520us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1784044153.982136:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:2.0:1784044154.107780:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044154.107954:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583004800 00000100:00100000:1.0:1784044154.107983:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583004800 00000100:00100000:1.0:1784044154.108043:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 160 00000100:00100000:1.0:1784044154.108053:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+47:11442:x1870705583004800:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1784044154.108078:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044154.108099:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8c4 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044154.108202:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044154.108217:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8b6 expref: 48 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044154.108226:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044154.108269:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8b6 expref: 48 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044154.108281:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8b6 expref: 48 pid: 5771 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044154.108294:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc563f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598733440:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044154.108482:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044154.121293:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc563f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598733440:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044154.121324:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044154.122379:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044154.122714:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583004928 00000100:00100000:0.0:1784044154.122723:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583004928 00010000:00010000:0.0:1784044154.122763:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8b6 expref: 49 pid: 5771 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044154.122807:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:0.0:1784044154.122816:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+49:2347:x1870705583004928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044154.122831:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044154.122849:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8b6 expref: 49 pid: 5771 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.122889:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8b6 expref: 49 pid: 5771 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.122925:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7550b41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8b6 expref: 49 pid: 5771 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.122946:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:0.0:1784044154.122950:0:5757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.123134:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.123142:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.123173:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044154.123228:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+48:2347:x1870705583004928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 413us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.123311:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00010000:00010000:2.0:1784044154.123386:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.123395:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044154.123415:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1784044154.123561:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7550b56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8c4 expref: 49 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.123578:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8c4 expref: 48 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.123592:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:2.0:1784044154.123595:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784044154.123598:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fde00, rc 0) 00000100:00100000:2.0:1784044154.123624:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+48:11442:x1870705583004800:12345-192.168.204.50@tcp:101:bash.0 Request processed in 15573us (15852us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1784044154.123631:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 160 00000100:00100000:1.0:1784044154.138396:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044154.138608:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583005184 00000100:00100000:2.0:1784044154.138618:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583005184 00000100:00100000:2.0:1784044154.138741:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 161 00000100:00100000:2.0:1784044154.138752:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+48:11442:x1870705583005184:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:2.0:1784044154.139086:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.139103:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.139113:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044154.139165:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1784044154.139187:0:7482:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003475388a reply state 00000000855fe5eb transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044154.139196:0:7482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044154.139291:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+51:11442:x1870705583005184:12345-192.168.204.50@tcp:36:bash.0 Request processed in 540us (903us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1784044154.139300:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 161 00000020:00080000:2.0:1784044154.139318:0:7482:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784044154.143325:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.143345:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.143352:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.143358:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044154.143364:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.143372:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.143390:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:2.0:1784044154.143393:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044154.143397:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.143404:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550b6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044154.143676:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044154.143783:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583005312 00000100:00100000:3.0:1784044154.143793:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583005312 00000100:00100000:3.0:1784044154.143904:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:3.0:1784044154.143915:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+50:11442:x1870705583005312:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1784044154.143938:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044154.143955:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550b72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8cb expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.144072:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.144086:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8c4 expref: 51 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.144095:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.144129:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8c4 expref: 51 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.144141:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8c4 expref: 51 pid: 5770 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044154.144154:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff551180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1870705598733568:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044154.144223:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7f53180 going to sleep for 11 seconds 00000100:00100000:1.0:1784044154.147467:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044154.147534:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583005440 00000100:00100000:2.0:1784044154.147545:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583005440 00010000:00010000:2.0:1784044154.147583:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8c4 expref: 52 pid: 5770 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044154.147622:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:2.0:1784044154.147632:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc563d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:2348:x1870705583005440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044154.147659:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044154.147666:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8c4 expref: 52 pid: 5770 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.147678:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8c4 expref: 52 pid: 5770 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.147699:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:2.0:1784044154.147703:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.147712:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.147719:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.147737:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044154.147795:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:2348:x1870705583005440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 165us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044154.147812:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00010000:00010000:3.0:1784044154.148767:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a7550b5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8c4 expref: 51 pid: 5770 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044154.148801:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff551180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1870705598733568:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044154.148851:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.149182:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.149192:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044154.149242:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784044154.149247:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044154.149268:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.149299:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550b72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8cb expref: 51 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.149315:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8cb expref: 50 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.149324:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:3.0:1784044154.149327:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044154.149330:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9be00, rc 0) 00000100:00100000:3.0:1784044154.149376:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc563f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+50:11442:x1870705583005312:12345-192.168.204.50@tcp:101:bash.0 Request processed in 5462us (5704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044154.149384:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:1.0:1784044154.152266:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044154.152313:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583005696 00000100:00100000:3.0:1784044154.152324:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583005696 00000100:00100000:3.0:1784044154.152379:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:3.0:1784044154.152390:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+50:11442:x1870705583005696:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:3.0:1784044154.152630:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+51:11442:x1870705583005696:12345-192.168.204.50@tcp:35:bash.0 Request processed in 241us (373us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1784044154.152637:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000004:00080000:1.0:1784044154.271495:0:7967:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332256627010ns, next at 333256497327ns, rc = 0 00000100:00100000:1.0:1784044154.271580:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044154.271617:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598733696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044154.271711:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044154.272024:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598733696 00000100:00100000:3.0:1784044154.272033:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598733696 00000100:00100000:3.0:1784044154.272101:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784044154.272111:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598733696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044154.272144:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044154.272197:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598733696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044154.272204:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1784044154.272251:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044154.272254:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598733696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044154.272363:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044154.272975:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583005952 00000100:00100000:3.0:1784044154.272981:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583005952 00000100:00100000:3.0:1784044154.273025:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 163 00000100:00100000:3.0:1784044154.273033:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+51:11452:x1870705583005952:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044154.273053:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044154.273074:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550b80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8d2 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044154.273182:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784044154.273291:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550b80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8d2 expref: 53 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.273317:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:3.0:1784044154.273320:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044154.273325:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550b80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8d2 expref: 53 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.273337:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b600, rc 0) 00000100:00100000:3.0:1784044154.273386:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:11452:x1870705583005952:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 353us (1024us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1784044154.273393:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 163 00000100:00100000:0.0:1784044154.288325:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044154.288363:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583006080 00000100:00100000:0.0:1784044154.288373:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583006080 00000100:00100000:0.0:1784044154.288431:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 164 00000100:00100000:0.0:1784044154.288441:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:11452:x1870705583006080:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1784044154.288525:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550b8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.288544:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550b8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.288558:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550b8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.288576:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550b95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.288584:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.288600:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.288694:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.288703:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.288710:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044154.289750:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.289770:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550b8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.289778:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550b8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.289785:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550b8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.289792:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044154.289796:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550b8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.289923:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550b8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.289940:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044154.289950:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044154.289957:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550b8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290201:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550b8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290213:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290219:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550b95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290225:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550b95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290230:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044154.290233:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550b95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290239:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550b95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290247:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bda59aa00) 00010000:00010000:0.0:1784044154.290250:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044154.290253:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550b95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290257:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550b95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290271:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290284:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290289:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290295:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044154.290298:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290304:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290313:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:0.0:1784044154.290315:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044154.290318:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.290323:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550b9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044154.290413:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:11452:x1870705583006080:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1969us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.290422:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 164 00000100:00100000:1.0:1784044154.294345:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044154.294394:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583006336 00000100:00100000:0.0:1784044154.294405:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583006336 00000100:00100000:0.0:1784044154.294477:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:0.0:1784044154.294490:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:11452:x1870705583006336:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044154.294967:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+53:11452:x1870705583006336:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 478us (629us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1784044154.294986:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000001:00080000:2.0:1784044154.320777:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1784044154.321512:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1784044154.363805:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044154.363980:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583006592 00000100:00100000:3.0:1784044154.363991:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583006592 00000100:00100000:3.0:1784044154.364054:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 165 00000100:00100000:3.0:1784044154.364065:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+53:11455:x1870705583006592:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044154.364091:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044154.364112:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550ba3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8d9 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364195:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550baa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364210:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550baa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364222:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550baa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364238:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364260:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364269:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364670:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550bb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364681:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364687:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044154.364695:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784044154.364783:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550baa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364791:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550baa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364798:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550baa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364804:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ac00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044154.364809:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550baa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.364816:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550baa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.365317:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044154.365322:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044154.365328:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550baa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.365335:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550baa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.365351:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.365357:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.365363:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.365536:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044154.365541:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.365549:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.365559:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bc7c1e300) 00010000:00010000:3.0:1784044154.365561:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044154.365564:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.365571:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.366235:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550ba3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8d9 expref: 56 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.366258:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8d9 expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.366280:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:2.0:1784044154.366282:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044154.366285:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a800, rc 0) 00000100:00100000:2.0:1784044154.366360:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:11455:x1870705583006592:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2295us (2566us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1784044154.366377:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 165 00000100:00100000:0.0:1784044154.372887:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044154.372936:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044154.373011:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583006720 00000100:00100000:1.0:1784044154.373012:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583006848 00000100:00100000:1.0:1784044154.373022:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583006848 00000100:00100000:3.0:1784044154.373023:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583006720 00000100:00100000:3.0:1784044154.373074:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 166 00000100:00100000:3.0:1784044154.373086:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:11455:x1870705583006720:12345-192.168.204.50@tcp:54:lfs.0 00000100:00100000:1.0:1784044154.373087:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1784044154.373100:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed282680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:2348:x1870705583006848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044154.373116:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044154.373147:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044154.373151:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550bb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8d9 expref: 56 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.373170:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.373182:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044154.373771:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:1.0:1784044154.373779:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044154.373977:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed282680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:2348:x1870705583006848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 877us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044154.373986:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00010000:00010000:3.0:1784044154.375638:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.375655:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.375663:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.375670:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044154.375676:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.375685:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.375703:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:3.0:1784044154.375721:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044154.375726:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.375733:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044154.375817:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+54:11455:x1870705583006720:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 2731us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044154.375827:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 166 00000100:00100000:0.0:1784044154.378603:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044154.378688:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583007104 00000100:00100000:1.0:1784044154.378698:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583007104 00000100:00100000:1.0:1784044154.378795:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:1.0:1784044154.378807:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+54:11455:x1870705583007104:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1784044154.379308:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:11455:x1870705583007104:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 500us (710us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1784044154.379318:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:0.0:1784044154.582853:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044154.583373:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583007360 00000100:00100000:2.0:1784044154.583383:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583007360 00000100:00100000:2.0:1784044154.583518:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:2.0:1784044154.583529:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:11473:x1870705583007360:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1784044154.583555:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044154.583576:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550bcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8e0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.583682:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550bd4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.583698:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.583710:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044154.583721:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784044154.583892:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550bcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8e0 expref: 58 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.583931:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8e0 expref: 57 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044154.583939:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:2.0:1784044154.583942:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784044154.583946:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4200, rc 0) 00000100:00100000:2.0:1784044154.584008:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:11473:x1870705583007360:12345-192.168.204.50@tcp:101:cat.0 Request processed in 481us (1164us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1784044154.584015:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:2.0:1784044154.605971:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044154.606161:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583007488 00000100:00100000:0.0:1784044154.606171:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583007488 00000100:00100000:0.0:1784044154.606233:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 168 00000100:00100000:0.0:1784044154.606243:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:11474:x1870705583007488:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044154.606267:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044154.606286:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550be2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8e7 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.606361:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.606375:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.606387:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044154.606445:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1784044154.606449:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044154.606470:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.606496:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8e7 expref: 59 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.606529:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8e7 expref: 58 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.606552:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044154.606555:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044154.606558:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7c00, rc 0) 00000100:00100000:0.0:1784044154.606928:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11474:x1870705583007488:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 685us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.606936:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 168 00000100:00100000:1.0:1784044154.615262:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044154.615395:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583007872 00000100:00100000:3.0:1784044154.615406:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583007872 00000100:00100000:3.0:1784044154.615465:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:3.0:1784044154.615476:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11474:x1870705583007872:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1784044154.615775:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:11474:x1870705583007872:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 299us (522us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1784044154.615783:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:2.0:1784044154.623372:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044154.623532:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583008000 00000100:00100000:0.0:1784044154.623551:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583008000 00000100:00100000:0.0:1784044154.623616:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:0.0:1784044154.623627:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:11474:x1870705583008000:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:0.0:1784044154.623643:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784044154.623669:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550b79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8cb expref: 59 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.623694:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550bd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8e0 expref: 58 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.623707:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550a84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead88c expref: 57 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044154.623717:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bd19d5400) 00010000:00010000:0.0:1784044154.623727:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044154.623797:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:11474:x1870705583008000:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 172us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.623805:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:0.0:1784044154.626326:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044154.626405:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583008128 00000100:00100000:3.0:1784044154.626416:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583008128 00000100:00100000:3.0:1784044154.626590:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 169 00000100:00100000:3.0:1784044154.626600:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:11474:x1870705583008128:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:3.0:1784044154.626696:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bf0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.626712:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.626723:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044154.626979:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1784044154.627696:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:11474:x1870705583008128:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 1095us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044154.627706:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 169 00000100:00100000:2.0:1784044154.670890:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044154.670979:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583008256 00000100:00100000:3.0:1784044154.671057:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583008256 00000100:00100000:3.0:1784044154.671120:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 170 00000100:00100000:3.0:1784044154.671131:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:11476:x1870705583008256:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044154.671154:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044154.671174:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8ee expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671240:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550bfe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671254:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671265:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671278:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550c05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671285:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671291:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671403:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671412:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671419:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044154.671798:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784044154.671803:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044154.671822:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671841:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671850:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671856:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550bfe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671886:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550bfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671893:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ac00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044154.671897:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550bfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671905:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550bfe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671925:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044154.671928:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044154.671932:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550bfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671939:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550bfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671952:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671958:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550c05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671963:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671969:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044154.671971:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671977:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550c05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.671984:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bc7c1e800) 00010000:00010000:3.0:1784044154.671986:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044154.672053:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550c05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.672060:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550c05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.672104:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a600/0x9cc73983a7550bf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8ee expref: 58 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.672116:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8ee expref: 57 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044154.672123:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:3.0:1784044154.672126:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044154.672128:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9ba00, rc 0) 00000100:00100000:3.0:1784044154.672190:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:11476:x1870705583008256:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1061us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044154.672198:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 170 00010000:00010000:2.0:1784044154.719797:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044154.750984:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044154.751284:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044154.751326:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044154.751497:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583008512 00000100:00100000:0.0:1784044154.751508:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583008512 00000100:00100000:0.0:1784044154.751575:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:0.0:1784044154.751586:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705583008512:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044154.751656:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705583008512:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 72us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.751665:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00080000:0.0:1784044154.751688:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044154.751759:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583008768 00000100:00100000:3.0:1784044154.751765:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583008768 00000100:00080000:0.0:1784044154.751792:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044154.751817:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 148 00000100:00100000:0.0:1784044154.751934:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705583008768:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044154.751981:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2346:x1870705583008768:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 156us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.751989:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 148 00000100:00100000:1.0:1784044154.752722:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583008384 00000100:00100000:1.0:1784044154.752732:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583008384 00000100:00100000:2.0:1784044154.752973:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044154.753136:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 295 00000100:00100000:1.0:1784044154.753148:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705583008384:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044154.753206:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2346:x1870705583008384:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 61us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044154.753215:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 295 00000100:00100000:3.0:1784044154.766236:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583008640 00000100:00100000:3.0:1784044154.766250:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583008640 00000100:00100000:1.0:1784044154.769425:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:1.0:1784044154.769440:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705583008640:12345-192.168.204.50@tcp:400:kworker.0 00000100:00080000:0.0:1784044154.769462:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044154.769532:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2346:x1870705583008640:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 95us (18142us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044154.769540:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00000040:00080000:0.0:1784044155.489106:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044155.489116:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044155.489156:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784044155.489164:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044155.489292:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598733824:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044155.489536:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc12ed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044155.501666:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044155.502101:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583008896 00000100:00100000:3.0:1784044155.502111:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583008896 00000100:00100000:3.0:1784044155.502181:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:3.0:1784044155.502192:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11487:x1870705583008896:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784044155.502238:0:5771:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784044155.502343:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11487:x1870705583008896:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 153us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044155.502351:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00080000:0.0:1784044155.502580:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044155.505450:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044155.505493:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583009024 00000100:00100000:0.0:1784044155.505503:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583009024 00000100:00100000:0.0:1784044155.505553:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 172 00000100:00100000:0.0:1784044155.505563:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11487:x1870705583009024:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784044155.505633:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550c13 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505648:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550c13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505661:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550c13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505708:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505716:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505723:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505750:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505758:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505764:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044155.505831:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784044155.505836:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044155.505848:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505859:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550c13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505882:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550c13 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505889:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550c13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505896:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044155.505900:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550c13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505909:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550c13 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505921:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:0.0:1784044155.505924:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044155.505929:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550c13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505935:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550c13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505946:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505962:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c1a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505967:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505972:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044155.505975:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505982:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c1a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.505989:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff904bda59aa00) 00010000:00010000:0.0:1784044155.505991:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044155.505994:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c1a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.506000:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.506014:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.506020:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.506026:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.506030:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044155.506039:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.506045:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.506053:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:0.0:1784044155.506055:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044155.506058:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.506063:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044155.506130:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11487:x1870705583009024:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 568us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044155.506138:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 172 00000100:00100000:2.0:1784044155.507358:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598733824:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044155.512982:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044155.513082:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583009280 00000100:00100000:3.0:1784044155.513100:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583009280 00000100:00100000:3.0:1784044155.513154:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 173 00000100:00100000:3.0:1784044155.513164:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:11487:x1870705583009280:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044155.513183:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044155.513202:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a7550c28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8f5 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513306:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550c2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513320:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513330:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044155.513339:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784044155.513447:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513456:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550c2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513462:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513468:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9bc00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044155.513473:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513481:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550c2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513500:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:3.0:1784044155.513503:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044155.513508:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550c2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513514:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550c2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513553:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a7550c28 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8f5 expref: 59 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513564:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:3.0:1784044155.513567:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044155.513570:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a7550c28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8f5 expref: 59 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.513579:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9aa00, rc 0) 00000100:00100000:3.0:1784044155.513644:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11487:x1870705583009280:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 480us (672us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1784044155.513652:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 173 00000100:00100000:1.0:1784044155.526490:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044155.526524:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583009408 00000100:00100000:1.0:1784044155.526533:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583009408 00000100:00100000:1.0:1784044155.526578:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 174 00000100:00100000:1.0:1784044155.526587:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11487:x1870705583009408:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784044155.526713:0:5769:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784044155.533630:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11487:x1870705583009408:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 4261us (4366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044155.533655:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 174 00000100:00100000:3.0:1784044155.542899:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044155.543074:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583009664 00000100:00100000:0.0:1784044155.543086:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583009664 00000100:00100000:0.0:1784044155.543228:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 175 00000100:00100000:0.0:1784044155.543240:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11487:x1870705583009664:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044155.543261:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044155.543264:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784044155.543290:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550be9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8e7 expref: 58 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.543306:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044155.543311:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044155.543332:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead8fc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784044155.543761:0:5771:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1784044155.544007:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.544021:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.544033:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.544088:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8fc expref: 60 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.544103:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8fc expref: 59 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.544111:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59aa00) 00010000:00010000:0.0:1784044155.544114:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044155.544117:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6600, rc 0) 00000100:00100000:0.0:1784044155.544180:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:11487:x1870705583009664:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 941us (1315us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1784044155.544188:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 175 00000100:00100000:0.0:1784044155.552773:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044155.552989:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583009920 00000100:00100000:1.0:1784044155.553000:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583009920 00000100:00100000:1.0:1784044155.553053:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 176 00000100:00100000:1.0:1784044155.553063:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:11487:x1870705583009920:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784044155.553236:0:7482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044155.553263:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8fc expref: 59 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553280:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59aa00) 00010000:00010000:1.0:1784044155.553289:0:7482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044155.553310:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550c52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553324:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550c52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553334:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550c52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553348:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550c59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x7ab1534a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553355:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ab1534a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553362:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ab1534a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553510:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550c52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553518:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550c52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553525:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550c52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553547:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fda00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044155.553551:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550c52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553558:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550c52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553568:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:1.0:1784044155.553570:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044155.553575:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550c52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553581:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550c52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553593:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ab1534a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553599:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550c59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ab1534a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.553605:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550c59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ab1534a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.554092:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044155.554096:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550c59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ab1534a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.554103:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550c59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ab1534a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.554190:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x7ab1534a (ffff904bc5fdb000) 00010000:00010000:1.0:1784044155.554192:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044155.554195:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550c59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7ab1534a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.554201:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550c59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7ab1534a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044155.554297:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11487:x1870705583009920:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1233us (1532us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784044155.554307:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 176 00000100:00100000:1.0:1784044155.561214:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044155.561295:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583010048 00000100:00100000:0.0:1784044155.561305:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583010048 00000100:00100000:0.0:1784044155.561368:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 177 00000100:00100000:0.0:1784044155.561378:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11487:x1870705583010048:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044155.561417:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044155.561439:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead903 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.561475:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.561489:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.561500:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.561597:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead903 expref: 60 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.561614:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead903 expref: 59 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.561623:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59a200) 00010000:00010000:0.0:1784044155.561626:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044155.561629:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7c00, rc 0) 00000100:00100000:0.0:1784044155.561682:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:11487:x1870705583010048:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 305us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044155.561689:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 177 00000100:00100000:3.0:1784044155.572023:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044155.572141:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583010304 00000100:00100000:0.0:1784044155.572151:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583010304 00000100:00100000:0.0:1784044155.572247:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 178 00000100:00100000:0.0:1784044155.572258:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:11487:x1870705583010304:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784044155.572366:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.572384:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.572395:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044155.572668:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1784044155.572690:0:5769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333557825101ns, next at 334557822436ns, rc = 0 00000004:00010000:0.0:1784044155.572781:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005614eb27 reply state 0000000033a2e04c transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044155.572791:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044155.572917:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11487:x1870705583010304:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 659us (902us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1784044155.572925:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 178 00010000:00010000:1.0:1784044155.580031:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.580050:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.580058:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.580064:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044155.580069:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.580076:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.580095:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59a200) 00010000:00010000:1.0:1784044155.580099:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784044155.580120:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.580128:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550c6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044155.581606:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044155.581842:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583010432 00000100:00100000:0.0:1784044155.581855:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583010432 00000100:00100000:0.0:1784044155.581928:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 179 00000100:00100000:0.0:1784044155.581939:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:11487:x1870705583010432:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044155.581965:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044155.581985:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550c75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead90a expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.582052:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550c75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead90a expref: 61 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.582079:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550c75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead90a expref: 61 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.582101:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59a200) 00010000:00010000:0.0:1784044155.582105:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044155.582108:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6400, rc 0) 00000100:00100000:0.0:1784044155.582172:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11487:x1870705583010432:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 235us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044155.582180:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 179 00000100:00100000:2.0:1784044155.587107:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044155.590090:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583010560 00000100:00100000:1.0:1784044155.590117:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583010560 00000100:00100000:1.0:1784044155.590189:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:1.0:1784044155.590199:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705583010560:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784044155.591211:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705583010560:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 1008us (4110us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1784044155.591223:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:1.0:1784044155.597579:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044155.597622:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583010816 00000100:00100000:1.0:1784044155.597633:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583010816 00000100:00100000:1.0:1784044155.597685:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1784044155.597697:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11487:x1870705583010816:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784044155.597958:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:11487:x1870705583010816:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 263us (388us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1784044155.597967:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000040:00080000:0.0:1784044155.602382:0:12349:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044155.602394:0:12349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044155.602437:0:12349:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784044155.602446:0:12349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044155.609741:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044155.610458:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583011072 00000100:00100000:1.0:1784044155.610470:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583011072 00000100:00100000:0.0:1784044155.610622:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 180 00000100:00100000:0.0:1784044155.610632:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:11487:x1870705583011072:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784044155.610734:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:11487:x1870705583011072:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 103us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044155.610741:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 180 00000100:00100000:1.0:1784044155.614294:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044155.614587:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583011200 00000100:00100000:0.0:1784044155.614596:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583011200 00000100:00100000:0.0:1784044155.614654:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 181 00000100:00100000:0.0:1784044155.614664:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:11487:x1870705583011200:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044155.614695:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044155.614728:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead911 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.614805:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.614958:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.614972:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044155.615011:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044155.615029:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.615054:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead911 expref: 64 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.615068:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead911 expref: 63 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.615077:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59a200) 00010000:00010000:0.0:1784044155.615079:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784044155.615082:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7600, rc 0) 00000100:00100000:0.0:1784044155.615158:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+63:11487:x1870705583011200:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 495us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044155.615166:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 181 00000100:00100000:0.0:1784044155.619183:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044155.619306:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583011328 00000100:00100000:3.0:1784044155.619316:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583011328 00000100:00100000:3.0:1784044155.619376:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:3.0:1784044155.619386:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705583011328:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044155.619414:0:6571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044155.619433:0:6571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a7550c8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead918 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044155.619461:0:6571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565a7b, blocks: 0x1 00010000:00010000:3.0:1784044155.619480:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1784044155.619484:0:6571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044155.619493:0:6571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a7550c8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead918 expref: 8 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.619511:0:6571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a7550c8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead918 expref: 8 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.619523:0:6571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9bc00, rc 0) 00000100:00100000:3.0:1784044155.619578:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705583011328:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 194us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044155.619585:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:0.0:1784044155.624764:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044155.624930:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583011584 00000100:00100000:1.0:1784044155.624941:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583011584 00000100:00100000:1.0:1784044155.624999:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 182 00000100:00100000:1.0:1784044155.625010:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+63:11487:x1870705583011584:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784044155.625124:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+63:11487:x1870705583011584:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 115us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044155.625131:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 182 00000100:00100000:2.0:1784044155.636641:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044155.638493:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583011712 00000100:00100000:3.0:1784044155.638507:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583011712 00000100:00100000:3.0:1784044155.638574:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:3.0:1784044155.638585:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:11487:x1870705583011712:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044155.638603:0:11907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044155.639497:0:11907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead91f expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.639542:0:11907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a7550c8a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead918 expref: 9 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.639567:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044155.639572:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044155.639579:0:11907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 9 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.639632:0:11907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a7550c8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead918 expref: 9 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.639648:0:11907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a7550c8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead918 expref: 9 pid: 6571 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044155.639662:0:11907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff553100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11907:1870705598733952:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044155.639767:0:11907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bffa99540 going to sleep for 11 seconds 00000100:00100000:3.0:1784044155.649458:0:11907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff553100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11907:1870705598733952:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044155.649499:0:11907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 9 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.649521:0:11907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a200, rc 0) 00000100:00100000:3.0:1784044155.649593:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:11487:x1870705583011712:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 11010us (12960us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044155.649602:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:0.0:1784044155.651464:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044155.651694:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583011840 00000100:00100000:2.0:1784044155.651707:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583011840 00010000:00010000:2.0:1784044155.651770:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a7550c8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead918 expref: 9 pid: 6571 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044155.652042:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:2.0:1784044155.652053:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2348:x1870705583011840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044155.652070:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044155.652093:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a7550c8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead918 expref: 9 pid: 6571 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.652119:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a7550c8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead918 expref: 9 pid: 6571 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.652146:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119dce05/0x9cc73983a7550c8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead918 expref: 9 pid: 6571 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.652163:0:5757:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044155.652168:0:5757:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044155.652178:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 8 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.652188:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 8 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.652228:0:5757:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 8 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044155.652257:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5757:1870705598734080:192.168.204.50@tcp:105: 00000100:00100000:2.0:1784044155.652351:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc3d77a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044155.657720:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5757:1870705598734080:192.168.204.50@tcp:105: 00010000:00010000:1.0:1784044155.657755:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044155.657848:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2348:x1870705583011840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5794us (8503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044155.657861:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:3.0:1784044155.668967:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044155.669428:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583011968 00000100:00100000:0.0:1784044155.669454:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583011968 00002000:00100000:0.0:1784044155.669587:0:6575:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff904bff553100 x1870705583011968/t0(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:306/0 lens 504/0 e 0 to 0 dl 1784044166 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044155.669600:0:6575:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bff553100 with x1870705583011968 ext(0->8) 00002000:00010000:0.0:1784044155.669619:0:6575:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904bff553100 00000100:00100000:0.0:1784044155.669707:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1784044155.669754:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705583011968:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784044155.672219:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:2347:x1870705583011968:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 2454us (3265us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1784044155.672235:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00002000:00100000:0.0:1784044155.672250:0:6575:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff904bff553100 x1870705583011968/t4294967315(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:306/0 lens 504/448 e 0 to 0 dl 1784044166 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044155.672261:0:6575:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bff553100 with x1870705583011968 ext(0->8) 00002000:00010000:0.0:1784044155.672268:0:6575:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904bff553100 00000100:00100000:3.0:1784044155.680707:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044155.680756:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583012096 00000100:00100000:3.0:1784044155.680787:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583012096 00000100:00100000:3.0:1784044155.686323:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 183 00000100:00100000:3.0:1784044155.686364:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+63:11487:x1870705583012096:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1784044155.743477:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784044155.750596:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1784044155.750617:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1784044155.750685:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1784044155.751388:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598734208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784044155.751495:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044155.751597:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598734208 00000100:00100000:0.0:1784044155.751607:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598734208 00000100:00100000:0.0:1784044155.751676:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784044155.751760:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598734208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1784044155.752061:0:6572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784044155.752066:0:6572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784044155 00002000:00010000:0.0:1784044155.752069:0:6572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784044155.752086:0:6572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784044155 -> 1784044155 00002000:00010000:0.0:1784044155.752088:0:6572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784044155.752147:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1870705598734208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 461us (652us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784044155.752157:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1784044155.752421:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1784044155.752473:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904ac2b9d880/2, rc 0, transno 4294967316 00000100:00100000:0.0:1784044155.752481:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598734208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784044155.752951:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598734336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784044155.753003:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044155.753056:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598734336 00000100:00100000:3.0:1784044155.753063:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598734336 00000100:00100000:3.0:1784044155.753104:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784044155.753113:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598734336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784044155.753144:0:8310:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000001:00080000:0.0:1784044155.753305:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1784044155.753323:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00002000:00010000:3.0:1784044155.753420:0:8310:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a565a78, atime: 0x6a565a78, ctime: 0x6a565a78, blocks: 0xb 00010000:00010000:3.0:1784044155.753432:0:8310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550c98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.753455:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1784044155.753461:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044155.753470:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550c98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.753501:0:8310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550c98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.753515:0:8310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550c98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.753524:0:8310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550c98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.753603:0:8310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784044155.754459:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598734336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1342us (1451us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1784044155.754471:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784044155.754550:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1784044155.754558:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1784044155.754590:0:3289:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff904bff552300 x1870705598734336/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784044171 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784044155.754605:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904bff552300/2, rc 0, transno 4294967307 00000100:00100000:3.0:1784044155.754611:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598734336:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1784044155.754855:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044155.754886:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550c98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.754900:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ac00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044155.754906:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550c98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.754917:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550c98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.754943:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550c98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.754952:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550c98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.754990:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044155.754992:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044155.754994:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784044155.759595:0:5791:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff904bf5ab76c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1784044155.759607:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bd024e500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff904bf5ab7a80 00000020:00080000:1.0:1784044155.759611:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bd024e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff904bff5e1800 00000100:00100000:3.0:1784044155.759691:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:11487:x1870705583012096:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 73339us (78986us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044155.759706:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 183 00000020:00080000:2.0:1784044155.759840:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1784044155.760150:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1784044155.773713:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044155.773772:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583012224 00000100:00100000:3.0:1784044155.773790:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583012224 00000100:00100000:3.0:1784044155.773903:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:3.0:1784044155.773916:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:2348:x1870705583012224:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784044155.832824:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:2348:x1870705583012224:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 58757us (58971us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044155.832843:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00000001:00080000:1.0:1784044155.833912:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1784044155.833931:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1784044155.837951:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044155.838158:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583012480 00000100:00100000:2.0:1784044155.838173:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583012480 00000100:00100000:2.0:1784044155.838274:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 184 00000100:00100000:2.0:1784044155.838286:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:11487:x1870705583012480:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784044155.838378:0:7482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044155.838428:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550c83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead911 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.838455:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59a200) 00010000:00010000:2.0:1784044155.838462:0:7482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044155.838518:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.838552:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.838565:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044155.839522:0:7482:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d00b19d9 reply state 000000005d075fbe transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044155.839554:0:7482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044155.839939:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:11487:x1870705583012480:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1651us (2002us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1784044155.839950:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 184 00000100:00100000:3.0:1784044155.857925:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044155.858742:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583012608 00000100:00100000:0.0:1784044155.858758:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583012608 00000100:00100000:0.0:1784044155.858848:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:0.0:1784044155.858862:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705583012608:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784044155.859272:0:6571:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784044155.859276:0:6571:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1784044155 -> 1784044154 00002000:00010000:0.0:1784044155.859279:0:6571:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784044152 00002000:00010000:0.0:1784044155.859281:0:6571:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784044155 -> 1784044154 00002000:00010000:0.0:1784044155.859283:0:6571:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1784044155.859368:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705583012608:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 508us (1460us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1784044155.859378:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00010000:00010000:2.0:1784044155.859722:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.859734:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.859761:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.859769:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044155.859775:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.859785:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.859818:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59a200) 00010000:00010000:2.0:1784044155.859821:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044155.859827:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.859836:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550c9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044155.863587:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044155.863678:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583012864 00000100:00100000:0.0:1784044155.863700:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583012864 00000100:00100000:0.0:1784044155.863787:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 185 00000100:00100000:0.0:1784044155.863801:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:11487:x1870705583012864:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784044155.863965:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.864174:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead903 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.864253:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.864324:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead903 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044155.864340:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead903 expref: 18 pid: 5770 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044155.864357:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffd2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1870705598734464:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044155.864521:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be06ba540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044155.869733:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044155.869842:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583012992 00000100:00100000:2.0:1784044155.869854:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583012992 00000100:00100000:3.0:1784044155.869909:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffd2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1870705598734464:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044155.869920:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead903 expref: 19 pid: 5770 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.869948:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044155.869962:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:2.0:1784044155.869972:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:2348:x1870705583012992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044155.869991:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044155.869999:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead903 expref: 19 pid: 5770 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.870026:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead903 expref: 19 pid: 5770 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.870057:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550c67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead903 expref: 19 pid: 5770 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.870076:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59a200) 00010000:00010000:2.0:1784044155.870082:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.870092:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.870102:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.870136:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044155.870198:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044155.870206:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:2348:x1870705583012992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 234us (494us total) trans 0 rc 0/0 00010000:00010000:3.0:1784044155.870212:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044155.870215:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00010000:00010000:3.0:1784044155.870254:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.870262:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.870276:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.870283:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044155.870288:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.870301:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.870312:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59a200) 00010000:00010000:3.0:1784044155.870316:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784044155.870320:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.870326:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550ca6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044155.870384:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:11487:x1870705583012864:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 6587us (6811us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784044155.870406:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 185 00000100:00100000:3.0:1784044155.875956:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044155.876239:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583013120 00000100:00100000:1.0:1784044155.876252:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583013120 00000100:00100000:1.0:1784044155.876328:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:1.0:1784044155.876340:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2346:x1870705583013120:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784044155.876403:0:6569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.876430:0:6569:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 8 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.876454:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044155.876459:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044155.876464:0:6569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.876513:0:6569:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 8 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.876530:0:6569:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 8 pid: 11907 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044155.876549:0:6569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6569:1870705598734592:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044155.876651:0:6569:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044155.881255:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044155.881499:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583013248 00000100:00100000:3.0:1784044155.881512:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583013248 00010000:00010000:3.0:1784044155.881573:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 9 pid: 11907 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044155.881631:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:3.0:1784044155.881642:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2347:x1870705583013248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044155.881667:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044155.881718:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 9 pid: 11907 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.881736:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 9 pid: 11907 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.881779:0:8289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044155.881791:0:8289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044155.881799:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.881825:0:8289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.881854:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044155.882153:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2347:x1870705583013248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 332us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044155.882170:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00010000:00010000:1.0:1784044155.882588:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde463df/0x9cc73983a7550c91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead91f expref: 8 pid: 11907 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044155.882606:0:6569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6569:1870705598734592:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044155.882638:0:6569:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.882655:0:6569:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.882663:0:6569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.882739:0:6569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.882753:0:6569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.882762:0:6569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.882776:0:6569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044155.882786:0:6569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.882796:0:6569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.882823:0:6569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.882831:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ebba24a/0x9cc73983a7550cad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044155.882939:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2346:x1870705583013120:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 6601us (7003us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044155.882950:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:1.0:1784044155.893194:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044155.896501:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583013504 00000100:00100000:2.0:1784044155.896524:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583013504 00000100:00100000:2.0:1784044155.896602:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 186 00000100:00100000:2.0:1784044155.896613:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+17:11487:x1870705583013504:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784044155.896728:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550cb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.896778:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.896793:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.897114:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.897127:0:7482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550c75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead90a expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.897135:0:7482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.897182:0:7482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550c75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead90a expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.897199:0:7482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550c75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead90a expref: 18 pid: 5769 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044155.897216:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598734720:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044155.897335:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb5d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044155.907769:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044155.908199:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598734720:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044155.908234:0:7482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044155.913523:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583013632 00000100:00100000:1.0:1784044155.913548:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583013632 00010000:00010000:1.0:1784044155.914818:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550c75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead90a expref: 19 pid: 5769 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044155.915034:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:1.0:1784044155.915053:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:2347:x1870705583013632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044155.915075:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044155.915085:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550c75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead90a expref: 19 pid: 5769 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.915102:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550c75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead90a expref: 19 pid: 5769 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.915132:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550c75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead90a expref: 19 pid: 5769 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.915148:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59a200) 00010000:00010000:1.0:1784044155.915155:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.915166:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.915176:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.915414:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044155.915510:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:2347:x1870705583013632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 463us (7751us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044155.915519:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 71 00010000:00010000:1.0:1784044155.919114:0:7482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.919137:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784044155.919426:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1784044155.919623:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1784044155.919675:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1784044155.919793:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7482:1870705598734848:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784044155.919914:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044155.919963:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044155.919991:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598734848 00000100:00100000:2.0:1784044155.920055:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598734848 00000100:00100000:2.0:1784044155.920153:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784044155.920192:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7482:x1870705598734848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784044155.920380:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7482:x1870705598734848:12345-0@lo:1000:mdt00_003.0 Request processed in 203us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044155.920388:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784044155.920393:0:7482:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1784044155.920399:0:7482:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904ac2b9d880, transno 4294967316 00000100:00100000:1.0:1784044155.920413:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7482:1870705598734848:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1784044155.924660:0:7482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1784044155.925172:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7482:1870705598734976:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784044155.925478:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044155.925529:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044155.925921:0:11851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598734976 00000100:00100000:2.0:1784044155.925934:0:11851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598734976 00000100:00100000:2.0:1784044155.926299:0:11851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044155.926311:0:11851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7482:x1870705598734976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784044155.927027:0:11851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7482:x1870705598734976:12345-0@lo:1000:mdt00_003.0 Request processed in 714us (1546us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1784044155.927039:0:11851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044155.933790:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7482:1870705598734976:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1784044155.934037:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934050:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934077:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934084:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044155.934089:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934098:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934118:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bda59a200) 00010000:00010000:1.0:1784044155.934122:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044155.934127:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934134:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4800/0x9cc73983a7550cbb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934177:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934255:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bf0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934262:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bf0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934267:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044155.934270:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bf0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934288:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bf0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934298:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:1.0:1784044155.934300:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044155.934303:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bf0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934309:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550bf0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934336:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934353:0:7482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8ee expref: 21 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934363:0:7482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934415:0:7482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8ee expref: 21 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.934435:0:7482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8ee expref: 21 pid: 5771 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044155.934452:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598735104:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044155.934576:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044155.948324:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598735104:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044155.948374:0:7482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044155.948425:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044155.948475:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583013760 00000100:00100000:2.0:1784044155.948486:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583013760 00010000:00010000:2.0:1784044155.948539:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8ee expref: 22 pid: 5771 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044155.948586:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:2.0:1784044155.948598:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:2348:x1870705583013760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044155.948621:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044155.948630:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8ee expref: 22 pid: 5771 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.948644:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8ee expref: 22 pid: 5771 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.949137:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead8ee expref: 22 pid: 5771 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.949158:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:2.0:1784044155.949163:0:5757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.949175:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.949193:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.949229:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044155.949324:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:2348:x1870705583013760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 722us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044155.949334:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00010000:00010000:1.0:1784044155.949339:0:7482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949357:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949373:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949381:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949388:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949396:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fda00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044155.949401:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949410:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949420:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:1.0:1784044155.949423:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044155.949426:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949433:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550cc2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949462:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949467:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550cb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949473:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550cb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949478:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044155.949481:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550cb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949486:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550cb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949493:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:1.0:1784044155.949495:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784044155.949498:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550cb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.949503:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7550cb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044155.952164:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:11487:x1870705583013504:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 55251us (58690us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1784044155.952193:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 186 00000020:00080000:1.0:1784044155.952413:0:7482:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1784044155.956588:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044155.956671:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583014016 00000100:00100000:3.0:1784044155.956689:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583014016 00000100:00100000:3.0:1784044155.956799:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:3.0:1784044155.956820:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfec9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:11487:x1870705583014016:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784044155.958115:0:5772:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784044155.958745:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1784044155.958840:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.960124:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.960153:0:5772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.960166:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.960174:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044155.960317:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044155.960724:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044155.961050:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044155.961149:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.961158:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a800 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044155.961163:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.961174:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.961493:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff904bc7c1e800) 00010000:00010000:1.0:1784044155.961498:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784044155.961504:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044155.961512:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550cc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044155.961638:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfec9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:11487:x1870705583014016:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 4812us (5058us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1784044155.961651:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000020:00080000:2.0:1784044155.961661:0:5772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784044155.962121:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044155.962125:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044155.962127:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044156.767734:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044156.959341:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044156.959354:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044156.959924:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1784044156.959940:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1784044157.790236:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044158.062232:0:12403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044158.062242:0:12403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044158.062277:0:12403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784044158.062284:0:12403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784044158.190562:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.190823:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583014272 00000100:00100000:3.0:1784044158.190840:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583014272 00000100:00100000:3.0:1784044158.190940:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 187 00000100:00100000:3.0:1784044158.190951:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:11505:x1870705583014272:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044158.190975:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044158.190994:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead926 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.191252:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550cd7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.191267:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.191279:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044158.191291:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1784044158.191461:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead926 expref: 25 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.191478:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead926 expref: 24 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.191487:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044158.191490:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044158.191493:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b600, rc 0) 00000100:00100000:3.0:1784044158.191560:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:11505:x1870705583014272:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 611us (1009us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1784044158.191568:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 187 00000100:00080000:0.0:1784044158.191647:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044158.194164:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044158.194285:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583014400 00000100:00100000:0.0:1784044158.194297:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583014400 00000100:00100000:0.0:1784044158.194369:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 188 00000100:00100000:0.0:1784044158.194383:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:11505:x1870705583014400:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1784044158.194487:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550ce5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.194508:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.194522:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.194539:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.194546:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.194553:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195352:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195365:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195373:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044158.195426:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195449:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195456:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550ce5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195464:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195472:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.195476:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195485:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550ce5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195498:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044158.195501:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.195507:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550ce5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195513:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550ce5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195525:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195531:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550cec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195538:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195547:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.195551:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195558:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550cec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195565:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bda59ac00) 00010000:00010000:0.0:1784044158.195567:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.195570:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550cec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195576:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550cec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195591:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195598:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195603:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195607:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.195610:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195617:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195633:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bda59a600) 00010000:00010000:0.0:1784044158.195635:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.195638:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.195644:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550cf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044158.195827:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:11505:x1870705583014400:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1439us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044158.195837:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 188 00000100:00100000:1.0:1784044158.286341:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.287546:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583014656 00000100:00100000:3.0:1784044158.287564:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583014656 00000100:00100000:3.0:1784044158.287653:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 189 00000100:00100000:3.0:1784044158.287667:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+24:11508:x1870705583014656:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044158.287696:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044158.287725:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550cfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead92d expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.287976:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550d01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.287996:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288011:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288031:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288039:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288046:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288503:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288513:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288533:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044158.288544:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784044158.288661:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288669:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550d01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288677:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550d01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288684:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044158.288689:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550d01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288697:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550d01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288712:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044158.288715:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044158.288721:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550d01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288727:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288739:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288746:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550d08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288758:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288903:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044158.288907:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288969:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288981:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bc7c1e600) 00010000:00010000:3.0:1784044158.288984:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044158.288987:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550d08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.288993:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.289048:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550cfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead92d expref: 27 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.289065:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead92d expref: 26 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.289073:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044158.289075:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044158.289078:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9be00, rc 0) 00000100:00100000:3.0:1784044158.289234:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:11508:x1870705583014656:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1569us (2912us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1784044158.289253:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 189 00000100:00100000:1.0:1784044158.293792:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044158.294921:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583014784 00000100:00100000:0.0:1784044158.294936:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583014784 00000100:00100000:0.0:1784044158.295078:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:0.0:1784044158.295091:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:11508:x1870705583014784:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:0.0:1784044158.295182:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.295203:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.295216:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.295251:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.295259:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.295288:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.295295:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.295301:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.295310:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.295325:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044158.295329:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044158.295334:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.295343:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044158.295454:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:11508:x1870705583014784:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 365us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044158.295463:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:0.0:1784044158.300166:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044158.300506:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583015040 00000100:00100000:1.0:1784044158.300520:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583015040 00000100:00100000:1.0:1784044158.300596:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:1.0:1784044158.300608:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:11508:x1870705583015040:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1784044158.303578:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:11508:x1870705583015040:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 2958us (3413us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1784044158.303593:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:2.0:1784044158.354688:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044158.354800:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583015296 00000100:00100000:0.0:1784044158.355090:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583015296 00000100:00100000:0.0:1784044158.355216:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 191 00000100:00100000:0.0:1784044158.355229:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:11034:x1870705583015296:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044158.355263:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044158.355290:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead934 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.355464:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.355482:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead92d expref: 28 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.355493:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.355539:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead92d expref: 28 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.355554:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead92d expref: 28 pid: 5771 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044158.355571:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffd2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598735232:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044158.355681:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be06ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044158.359663:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffd2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598735232:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044158.359704:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044158.366481:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044158.366676:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583015424 00000100:00100000:1.0:1784044158.366686:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583015424 00010000:00010000:1.0:1784044158.366726:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead92d expref: 29 pid: 5771 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044158.366790:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:1.0:1784044158.366802:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:2347:x1870705583015424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044158.366816:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044158.366829:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead92d expref: 29 pid: 5771 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.366843:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead92d expref: 29 pid: 5771 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.366896:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550d0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead92d expref: 29 pid: 5771 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.366915:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:1.0:1784044158.366921:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.366930:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.366938:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.366970:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044158.367025:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:2347:x1870705583015424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 225us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.367032:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00010000:00010000:3.0:1784044158.370099:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.370122:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044158.370157:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784044158.370400:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7550d24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead934 expref: 29 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.370428:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead934 expref: 28 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.370440:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044158.370443:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044158.370448:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6a00, rc 0) 00000100:00100000:3.0:1784044158.370826:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:11034:x1870705583015296:12345-192.168.204.50@tcp:101:bash.0 Request processed in 15597us (16150us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1784044158.370837:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 191 00000100:00100000:1.0:1784044158.374738:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044158.374844:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583015680 00000100:00100000:0.0:1784044158.374857:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583015680 00000100:00100000:0.0:1784044158.375264:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 192 00000100:00100000:0.0:1784044158.375280:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:11034:x1870705583015680:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:0.0:1784044158.375659:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.375693:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.375708:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044158.375781:0:5769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1784044158.375821:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068cac38f reply state 00000000dfcd21cc transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044158.375833:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1784044158.375961:0:5769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1784044158.376745:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:11034:x1870705583015680:12345-192.168.204.50@tcp:36:bash.0 Request processed in 1464us (2018us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1784044158.376755:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 192 00000020:00080000:0.0:1784044158.376770:0:5769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1784044158.379374:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.379454:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.379463:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.379470:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.379476:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.379485:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.379527:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044158.379530:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.379589:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.379598:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044158.383719:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044158.385322:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583015808 00000100:00100000:1.0:1784044158.385338:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583015808 00000100:00100000:0.0:1784044158.385544:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 193 00000100:00100000:0.0:1784044158.385558:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:11034:x1870705583015808:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044158.385591:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044158.385619:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550d40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead93b expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.385701:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550d40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead93b expref: 32 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.385720:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550d40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead93b expref: 32 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.385744:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044158.385748:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044158.385752:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7a00, rc 0) 00000100:00100000:0.0:1784044158.385940:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:11034:x1870705583015808:12345-192.168.204.50@tcp:101:bash.0 Request processed in 383us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044158.385949:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 193 00000100:00100000:1.0:1784044158.395751:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.395919:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583015936 00000100:00100000:3.0:1784044158.395932:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583015936 00000100:00100000:3.0:1784044158.396090:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:3.0:1784044158.396103:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:11034:x1870705583015936:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1784044158.396126:0:11907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044158.396155:0:11907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e313690/0x9cc73983a7550d47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead942 expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044158.396203:0:11907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a565a7a, atime: 0x6a565a78, ctime: 0x6a565a7a, blocks: 0xb 00010000:00010000:3.0:1784044158.396233:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1784044158.396239:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044158.396250:0:11907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e313690/0x9cc73983a7550d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead942 expref: 8 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.396271:0:11907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e313690/0x9cc73983a7550d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead942 expref: 8 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.396287:0:11907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9ba00, rc 0) 00000100:00100000:3.0:1784044158.396359:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:11034:x1870705583015936:12345-192.168.204.50@tcp:101:bash.0 Request processed in 259us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044158.396367:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00080000:0.0:1784044158.396667:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044158.405982:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044158.406139:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583016064 00000100:00100000:1.0:1784044158.406150:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583016064 00002000:00010000:1.0:1784044158.406192:0:6577:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1784044158.406197:0:6577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bf5ba0e00 with x1870705583016064 ext(0->18446744073709551615) 00002000:00010000:1.0:1784044158.406208:0:6577:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904bf5ba0e00. 00000100:00100000:1.0:1784044158.406239:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:1.0:1784044158.406250:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2348:x1870705583016064:12345-192.168.204.50@tcp:10:bash.0 00002000:00010000:1.0:1784044158.406519:0:6577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1784044158.406522:0:6577:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1784044154 -> 1784044158 00002000:00010000:1.0:1784044158.406525:0:6577:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1784044152 -> 1784044152 00002000:00010000:1.0:1784044158.406527:0:6577:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784044154 -> 1784044158 00002000:00010000:1.0:1784044158.406529:0:6577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1784044158.406592:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2348:x1870705583016064:12345-192.168.204.50@tcp:10:bash.0 Request processed in 343us (618us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1784044158.406599:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00002000:00010000:1.0:1784044158.406602:0:6577:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1784044158.406605:0:6577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bf5ba0e00 with x1870705583016064 ext(0->18446744073709551615) 00002000:00010000:1.0:1784044158.406610:0:6577:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904bf5ba0e00. 00000100:00100000:3.0:1784044158.464816:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044158.465051:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583016192 00000100:00100000:0.0:1784044158.465060:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583016192 00000100:00100000:0.0:1784044158.465122:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:0.0:1784044158.465132:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:11522:x1870705583016192:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1784044158.465200:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465218:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465228:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465242:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465249:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465255:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465539:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465548:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465555:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044158.465594:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465615:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465621:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465628:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465633:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.465638:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465645:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465658:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044158.465660:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.465664:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465670:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465681:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465687:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465693:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465704:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.465707:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465713:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465721:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bda59a600) 00010000:00010000:0.0:1784044158.465723:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.465726:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465732:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465745:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465752:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465769:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465775:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.465778:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465784:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465802:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044158.465804:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.465807:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.465813:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044158.466477:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:11522:x1870705583016192:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1343us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044158.466487:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:3.0:1784044158.517922:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044158.518031:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583016448 00000100:00100000:0.0:1784044158.518052:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583016448 00000100:00100000:0.0:1784044158.518156:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 195 00000100:00100000:0.0:1784044158.518168:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+32:11525:x1870705583016448:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044158.518189:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044158.518210:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead949 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518297:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518312:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518324:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518340:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518362:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518370:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518749:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550d78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518772:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518780:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044158.518791:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784044158.518926:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518933:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518940:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518946:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.518950:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518958:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518982:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044158.518985:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.518990:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.518997:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550d6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.519010:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.519017:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.519023:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.519027:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.519031:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.519042:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.519052:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bda59a600) 00010000:00010000:0.0:1784044158.519055:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.519058:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.519065:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.519120:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550d63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead949 expref: 35 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.519135:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead949 expref: 34 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.519142:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044158.519145:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784044158.519147:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7000, rc 0) 00000100:00100000:0.0:1784044158.519216:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:11525:x1870705583016448:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1050us (1303us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1784044158.519224:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 195 00000100:00100000:1.0:1784044158.521424:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044158.521520:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583016576 00000100:00100000:0.0:1784044158.521529:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583016576 00000100:00100000:0.0:1784044158.521619:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 196 00000100:00100000:0.0:1784044158.521629:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:11525:x1870705583016576:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:0.0:1784044158.521698:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.521714:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead934 expref: 34 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.521723:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.521772:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead934 expref: 34 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.521804:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead934 expref: 34 pid: 5770 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044158.521826:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffd2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598735360:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044158.521945:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be06ba900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044158.530555:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044158.530656:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583016832 00000100:00100000:2.0:1784044158.530666:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583016832 00000100:00100000:2.0:1784044158.530730:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:2.0:1784044158.530740:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:5564:x1870705583016832:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784044158.531234:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:5564:x1870705583016832:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 494us (686us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1784044158.531242:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:0.0:1784044158.531440:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffd2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598735360:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044158.531463:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044158.535537:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.535630:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583016960 00000100:00100000:3.0:1784044158.535640:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583016960 00010000:00010000:3.0:1784044158.535680:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead934 expref: 36 pid: 5770 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044158.539075:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:3.0:1784044158.539098:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:2347:x1870705583016960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044158.539114:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044158.539136:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead934 expref: 36 pid: 5770 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.539148:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead934 expref: 36 pid: 5770 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.539166:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a7550d2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead934 expref: 36 pid: 5770 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.539179:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044158.539182:0:8289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.539189:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.539194:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.539279:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044158.539390:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:2347:x1870705583016960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 303us (3861us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044158.539398:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00010000:00010000:0.0:1784044158.539549:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.539558:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.539588:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.539594:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.539600:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.539605:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7c00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.539609:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.539615:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.539643:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044158.539646:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044158.539650:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.539655:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550d86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044158.539708:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:11525:x1870705583016576:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 18080us (18293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044158.539717:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 196 00000100:00100000:1.0:1784044158.548857:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.548939:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583017216 00000100:00100000:3.0:1784044158.548949:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583017216 00000100:00100000:3.0:1784044158.549023:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:3.0:1784044158.549044:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+34:11525:x1870705583017216:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1784044158.549292:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:11525:x1870705583017216:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 252us (437us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1784044158.549314:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:1.0:1784044158.672988:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.673441:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583017472 00000100:00100000:3.0:1784044158.673453:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583017472 00000100:00100000:3.0:1784044158.673566:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 197 00000100:00100000:3.0:1784044158.673576:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+35:11536:x1870705583017472:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1784044158.673601:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044158.673633:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550d8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead950 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.673707:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550d94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.673722:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550d94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.673734:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550d94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.673750:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550d9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.673771:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.673779:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674146:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a7550da2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674168:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a7550da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674177:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a7550da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044158.674188:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1784044158.674293:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550d94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674301:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550d94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674308:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550d94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674314:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ac00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044158.674319:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550d94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674326:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550d94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674339:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044158.674342:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044158.674346:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550d94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674352:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550d94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674363:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674376:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550d9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674382:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674387:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9bc00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044158.674390:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674397:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550d9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674405:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bc7c1e700) 00010000:00010000:3.0:1784044158.674408:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044158.674410:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550d9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674415:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550d9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674454:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550d8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead950 expref: 38 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674469:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a7550da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead950 expref: 37 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.674476:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044158.674479:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044158.674487:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9aa00, rc 0) 00000100:00100000:3.0:1784044158.674555:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:11536:x1870705583017472:12345-192.168.204.50@tcp:101:cat.0 Request processed in 980us (1577us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1784044158.674564:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 197 00000100:00100000:1.0:1784044158.679980:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044158.680084:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583017728 00000100:00100000:2.0:1784044158.680094:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583017728 00000100:00100000:2.0:1784044158.680145:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:2.0:1784044158.680156:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:11536:x1870705583017728:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1784044158.680391:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+38:11536:x1870705583017728:12345-192.168.204.50@tcp:35:cat.0 Request processed in 237us (419us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1784044158.680399:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:1.0:1784044158.700814:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.701315:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583017984 00000100:00100000:3.0:1784044158.701325:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583017984 00000100:00100000:3.0:1784044158.701386:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 198 00000100:00100000:3.0:1784044158.701397:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+38:11537:x1870705583017984:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:3.0:1784044158.701455:0:7482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784044158.701483:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9aa00/0x9cc73983a7550da2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead950 expref: 38 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.701505:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7000/0x9cc73983a7550d78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead949 expref: 37 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.701518:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7a00/0x9cc73983a7550d40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead93b expref: 36 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.701528:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044158.701538:0:7482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044158.701564:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550db0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.701578:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.701588:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.701615:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.701623:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.701630:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.701998:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550dbe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702007:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550dbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702014:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550dbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044158.702589:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1784044158.702600:0:7482:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336687734566ns, next at 337687732656ns, rc = 0 00010000:00010000:3.0:1784044158.702654:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702664:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702673:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702680:0:7482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702696:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702703:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702727:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044158.702746:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550dbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702762:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550dbe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702769:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550dbe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702776:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ac00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044158.702780:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550dbe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702787:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550dbe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702797:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1e800) 00010000:00010000:3.0:1784044158.702800:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784044158.702803:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550dbe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702810:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ac00/0x9cc73983a7550dbe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702824:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702837:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550db0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702843:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550db0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702848:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044158.702851:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550db0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702857:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550db0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702893:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044158.702895:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044158.702899:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550db0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.702904:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550db0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.702907:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:3.0:1784044158.702914:0:7482:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000770c50a3 reply state 000000005cc973ed transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.702922:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044158.702923:0:7482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784044158.702927:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ae00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044158.702930:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.702936:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.702944:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff904bc7c1e800) 00010000:00010000:2.0:1784044158.702946:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784044158.702955:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.702960:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550dc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.702973:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044158.702974:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044158.702976:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044158.703015:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+37:11537:x1870705583017984:12345-192.168.204.50@tcp:36:rm.0 Request processed in 1616us (2207us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1784044158.703024:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 198 00010000:00010000:2.0:1784044158.714971:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.714989:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.714996:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.715002:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9bc00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044158.715009:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.715016:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.715039:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bc7c1e700) 00010000:00010000:2.0:1784044158.715043:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044158.715047:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.715053:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550db7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044158.758068:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044158.758188:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583018240 00000100:00100000:0.0:1784044158.758197:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583018240 00000100:00100000:0.0:1784044158.758329:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 199 00000100:00100000:0.0:1784044158.758340:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+36:11543:x1870705583018240:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044158.759999:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044158.760038:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550dcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead957 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.760214:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550dd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.760229:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550dd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.760241:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550dd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.760256:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.760270:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.760277:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784044158.762474:0:5770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1784044158.762698:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.762714:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.762726:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.762781:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550dd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.762790:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550dd3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.762797:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550dd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.762804:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.762808:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550dd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.764037:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550dd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.764076:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044158.764079:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.764085:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550dd3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.764092:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550dd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044158.764110:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000471ba184 reply state 00000000fa3fc956 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044158.764120:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784044158.764169:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7c00/0x9cc73983a7550dcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead957 expref: 39 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.764185:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead957 expref: 38 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.764192:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bda59ac00) 00010000:00010000:0.0:1784044158.764195:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044158.764198:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6400, rc 0) 00000100:00100000:0.0:1784044158.764299:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+39:11543:x1870705583018240:12345-192.168.204.50@tcp:101:bash.0 Request processed in 5960us (6241us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1784044158.764310:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 199 00010000:00010000:0.0:1784044158.766763:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.766780:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.766807:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.766826:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044158.766831:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.766839:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.766856:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bda59a600) 00010000:00010000:0.0:1784044158.766859:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044158.766880:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.766888:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550dda lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044158.769734:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.770092:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583018368 00000100:00100000:3.0:1784044158.770102:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583018368 00000100:00100000:3.0:1784044158.770180:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:3.0:1784044158.770191:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705583018368:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1784044158.770209:0:8310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044158.770230:0:8310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550def lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead95e expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044158.770255:0:8310:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784044158.770278:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1784044158.770283:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044158.770291:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead95e expref: 6 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.770309:0:8310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead95e expref: 6 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.770320:0:8310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a400, rc 0) 00000100:00100000:3.0:1784044158.770382:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2345:x1870705583018368:12345-192.168.204.50@tcp:101:bash.0 Request processed in 193us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044158.770389:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00080000:0.0:1784044158.773255:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044158.774826:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.775043:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583018496 00000100:00100000:3.0:1784044158.775054:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583018496 00000100:00100000:3.0:1784044158.775113:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:3.0:1784044158.775123:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:11543:x1870705583018496:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1784044158.775140:0:6569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044158.775158:0:6569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead965 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.775209:0:6569:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550def lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead95e expref: 7 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.775218:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044158.775223:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044158.775229:0:6569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 7 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.775262:0:6569:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead95e expref: 7 pid: 8310 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.775275:0:6569:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550def lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead95e expref: 7 pid: 8310 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044158.775289:0:6569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beee39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6569:1870705598735488:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044158.775375:0:6569:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc3822780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044158.778166:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044158.778300:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583018624 00000100:00100000:1.0:1784044158.778310:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583018624 00010000:00010000:1.0:1784044158.778347:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550def lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead95e expref: 8 pid: 8310 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044158.778391:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:1.0:1784044158.778401:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2348:x1870705583018624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044158.778413:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044158.778435:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550def lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead95e expref: 8 pid: 8310 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.778449:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550def lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead95e expref: 8 pid: 8310 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.778472:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044158.778477:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044158.778485:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 8 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.778496:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 8 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.778531:0:5756:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 8 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044158.778563:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5756:1870705598735616:192.168.204.50@tcp:105: 00000100:00100000:1.0:1784044158.778655:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5075b40 going to sleep for 11 seconds 00010000:00010000:3.0:1784044158.778896:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550def lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead95e expref: 8 pid: 8310 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044158.778917:0:6569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beee39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6569:1870705598735488:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044158.778944:0:6569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 7 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.778955:0:6569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9ac00, rc 0) 00000100:00100000:3.0:1784044158.778996:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:11543:x1870705583018496:12345-192.168.204.50@tcp:101:bash.0 Request processed in 3874us (4189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044158.779004:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:2.0:1784044158.783477:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.783557:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583018880 00000100:00100000:3.0:1784044158.783566:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583018880 00000100:00100000:3.0:1784044158.783628:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:3.0:1784044158.783639:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+38:11543:x1870705583018880:12345-192.168.204.50@tcp:35:bash.0 00000001:00080000:3.0:1784044158.783985:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967483 00000100:00100000:3.0:1784044158.784089:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:11543:x1870705583018880:12345-192.168.204.50@tcp:35:bash.0 Request processed in 450us (621us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1784044158.784097:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000020:00080000:3.0:1784044158.784102:0:5773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784044158.784511:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5756:1870705598735616:192.168.204.50@tcp:105: 00010000:00010000:1.0:1784044158.784534:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044158.784574:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2348:x1870705583018624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6174us (6416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.784582:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00010000:00010000:3.0:1784044158.814066:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044158.878221:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598736000:0@lo:400:kworker.0 00000100:00100000:3.0:1784044158.878290:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044158.878353:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044158.878361:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598736128:0@lo:400:kworker.0 00000100:00100000:3.0:1784044158.878388:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044158.878427:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598736000 00000100:00100000:3.0:1784044158.878434:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598736000 00000100:00080000:3.0:1784044158.878461:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044158.878498:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784044158.878507:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598736000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.878644:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beee39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598735744:0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.878678:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044158.878701:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598736256:0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.878723:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044158.878741:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784044158.878747:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598735872:0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.878781:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044158.878796:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598736384:0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.878815:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044158.878841:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598735744 00000100:00100000:1.0:1784044158.878845:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598735744 00000100:00100000:1.0:1784044158.878898:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1784044158.878906:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598735744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.878943:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598735744:12345-0@lo:400:kworker.0 Request processed in 38us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.878950:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1784044158.879005:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598736128 00000100:00100000:1.0:1784044158.879009:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598736128 00000100:00100000:1.0:1784044158.879039:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598736384 00000100:00100000:1.0:1784044158.879042:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598736384 00000100:00100000:1.0:1784044158.879063:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784044158.879069:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed934a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1870705598736128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.879108:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed934a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1870705598736128:12345-0@lo:400:kworker.0 Request processed in 39us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.879114:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784044158.879125:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784044158.879132:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598736384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.879160:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598736384:12345-0@lo:400:kworker.0 Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.879165:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1784044158.879182:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044158.879185:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044158.879208:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598736384:0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.879216:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beee39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598735744:0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.879273:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598736256 00000100:00100000:1.0:1784044158.879277:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598736256 00000100:00100000:1.0:1784044158.879300:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598735872 00000100:00100000:1.0:1784044158.879303:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598735872 00000100:00100000:1.0:1784044158.879315:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784044158.879320:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598736256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.879353:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598736256:12345-0@lo:400:kworker.0 Request processed in 32us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.879359:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784044158.879378:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784044158.879384:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598735872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.879412:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598735872:12345-0@lo:400:kworker.0 Request processed in 28us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.879418:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1784044158.879431:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044158.879447:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598735872:0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.879455:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598736256:0@lo:400:kworker.0 00000100:00100000:1.0:1784044158.879493:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598736128:0@lo:400:kworker.0 00000100:00100000:2.0:1784044158.879980:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044158.879991:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598736512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044158.880028:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044158.880104:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598736512 00000100:00100000:0.0:1784044158.880110:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598736512 00000100:00100000:0.0:1784044158.880148:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784044158.880155:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598736512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044158.880183:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044158.880221:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598736512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044158.880227:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784044158.880300:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598736512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044158.880889:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598736000:12345-0@lo:400:kworker.0 Request processed in 2381us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044158.880897:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784044158.880980:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598736000:0@lo:400:kworker.0 00000100:00100000:2.0:1784044158.913057:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044158.913146:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583019008 00000100:00100000:1.0:1784044158.913155:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583019008 00000100:00100000:1.0:1784044158.913212:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 200 00000100:00100000:1.0:1784044158.913221:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+40:11559:x1870705583019008:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044158.913244:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044158.913265:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550dfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead96c expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.913320:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550e04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.913334:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.913344:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044158.913418:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1784044158.913421:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044158.913442:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.913464:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550dfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead96c expref: 42 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.913482:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead96c expref: 41 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.913492:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:1.0:1784044158.913495:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044158.913497:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fda00, rc 0) 00000100:00100000:1.0:1784044158.913559:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:11559:x1870705583019008:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 339us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.913565:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 200 00000100:00100000:3.0:1784044158.925061:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044158.925177:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583019264 00000100:00100000:0.0:1784044158.925186:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583019264 00000100:00100000:0.0:1784044158.925251:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 201 00000100:00100000:0.0:1784044158.925261:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+41:11559:x1870705583019264:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044158.925283:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044158.925301:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead973 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.925400:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550e12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.925413:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.925425:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044158.925435:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1784044158.925566:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead973 expref: 44 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.925585:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550e12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead973 expref: 43 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.925592:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bda59ac00) 00010000:00010000:0.0:1784044158.925595:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044158.925599:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6e00, rc 0) 00000100:00100000:0.0:1784044158.925666:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+43:11559:x1870705583019264:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 405us (615us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1784044158.925673:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 201 00000100:00100000:0.0:1784044158.928896:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044158.929001:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583019648 00000100:00100000:2.0:1784044158.929011:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583019648 00000100:00100000:2.0:1784044158.929077:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:2.0:1784044158.929087:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+43:2348:x1870705583019648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044158.929103:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044158.929126:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550e12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead973 expref: 43 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.929143:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bda59ac00) 00010000:00010000:2.0:1784044158.929148:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044158.929169:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044158.929195:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+42:2348:x1870705583019648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044158.929203:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1784044158.929215:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583019520 00000100:00100000:0.0:1784044158.929219:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583019520 00000100:00100000:0.0:1784044158.929258:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 202 00000100:00100000:0.0:1784044158.929267:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+42:11559:x1870705583019520:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044158.929286:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044158.929300:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550e20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead97a expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.929384:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.929397:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.929407:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044158.929417:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1784044158.929522:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550e20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead97a expref: 45 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.929536:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead97a expref: 44 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.929543:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bda59ac00) 00010000:00010000:0.0:1784044158.929546:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784044158.929549:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7e00, rc 0) 00000100:00100000:0.0:1784044158.934771:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+44:11559:x1870705583019520:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5478us (5573us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1784044158.934803:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 202 00000100:00100000:0.0:1784044158.946542:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044158.946769:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583019776 00000100:00100000:3.0:1784044158.946779:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583019776 00000100:00100000:3.0:1784044158.946896:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:3.0:1784044158.946907:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+6:2346:x1870705583019776:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1784044158.946958:0:6569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.946978:0:6569:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 6 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.946986:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044158.946991:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044158.946995:0:6569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.947031:0:6569:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 6 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.947044:0:6569:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 6 pid: 6569 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044158.947058:0:6569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed936d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6569:1870705598736640:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044158.947135:0:6569:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc3822f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044158.951275:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044158.951341:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583019904 00000100:00100000:0.0:1784044158.951350:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583019904 00002000:00100000:0.0:1784044158.951397:0:6575:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff904bf5ba1f80 x1870705583019904/t0(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:309/0 lens 504/0 e 0 to 0 dl 1784044169 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044158.951408:0:6575:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bf5ba1f80 with x1870705583019904 ext(0->8) 00010000:00010000:0.0:1784044158.951416:0:6575:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 7 pid: 6569 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.951433:0:6575:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 7 pid: 6569 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044158.951441:0:6575:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff904bf5ba1f80 00000100:00100000:0.0:1784044158.951477:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1784044158.951487:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705583019904:12345-192.168.204.50@tcp:4:lfs.0 00000100:00100000:0.0:1784044158.952150:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2348:x1870705583019904:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 661us (881us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784044158.952158:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00002000:00100000:0.0:1784044158.952165:0:6575:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff904bf5ba1f80 x1870705583019904/t4294967308(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:309/0 lens 504/448 e 0 to 0 dl 1784044169 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044158.952174:0:6575:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904bf5ba1f80 with x1870705583019904 ext(0->8) 00010000:00010000:0.0:1784044158.952179:0:6575:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 9 pid: 6569 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044158.952204:0:6575:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 9 pid: 6569 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044158.952211:0:6575:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff904bf5ba1f80 00000100:00100000:2.0:1784044158.954798:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044158.955036:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583020032 00000100:00100000:1.0:1784044158.955046:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583020032 00010000:00010000:1.0:1784044158.955085:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 9 pid: 6569 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044158.955211:0:6569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed936d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6569:1870705598736640:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044158.955235:0:6569:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044158.955311:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:1.0:1784044158.955321:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2345:x1870705583020032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044158.955335:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784044158.955359:0:5755:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784044158.955362:0:5755:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784044159 00002000:00010000:1.0:1784044158.955364:0:5755:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784044159 00002000:00010000:1.0:1784044158.955366:0:5755:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1784044159 00010000:00010000:1.0:1784044158.955372:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 9 pid: 6569 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.955385:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 9 pid: 6569 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.955408:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000355747cd/0x9cc73983a7550df6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead965 expref: 9 pid: 6569 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.955424:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044158.955428:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044158.955434:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.955444:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.955477:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044158.955525:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2345:x1870705583020032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 204us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.955533:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 76 00010000:00010000:3.0:1784044158.955592:0:6569:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.955601:0:6569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.955634:0:6569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.955644:0:6569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.955652:0:6569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.955658:0:6569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a400 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044158.955663:0:6569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.955673:0:6569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.955683:0:6569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.955701:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000054c2499/0x9cc73983a7550e35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044158.955746:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2346:x1870705583019776:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 8840us (9214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044158.955765:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1784044158.962036:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044158.962163:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583020288 00000100:00100000:2.0:1784044158.962173:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583020288 00000100:00100000:2.0:1784044158.962269:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:2.0:1784044158.962281:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfecbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+44:11559:x1870705583020288:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:2.0:1784044158.962353:0:5773:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead97a expref: 44 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044158.962627:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1784044158.962676:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1784044158.963066:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1784044158.963116:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.963130:0:5773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead957 expref: 48 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.963139:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.963171:0:5773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead957 expref: 48 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.963185:0:5773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead957 expref: 48 pid: 5770 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044158.963199:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5773:1870705598736768:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044158.963276:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb5d5000 going to sleep for 11 seconds 00000100:00100000:3.0:1784044158.966974:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044158.967052:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583020416 00000100:00100000:1.0:1784044158.967061:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583020416 00010000:00010000:1.0:1784044158.967099:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead957 expref: 49 pid: 5770 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044158.967156:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:1.0:1784044158.967166:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+49:2347:x1870705583020416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044158.967185:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044158.967192:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead957 expref: 49 pid: 5770 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.967205:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead957 expref: 49 pid: 5770 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.967227:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bda59ac00) 00010000:00010000:1.0:1784044158.967232:0:5757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.967242:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.967250:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.967266:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044158.967311:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+49:2347:x1870705583020416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 146us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.967319:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00010000:00010000:2.0:1784044158.969140:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550de1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead957 expref: 48 pid: 5770 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044158.969164:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5773:1870705598736768:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044158.969188:0:5773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.969215:0:5773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044158.969221:0:5773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044158.969357:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1784044158.969801:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1784044158.970383:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed934700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598736896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784044158.970445:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044158.970507:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc3822240 going to sleep for 11 seconds 00000100:00100000:2.0:1784044158.970725:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598736896 00000100:00100000:2.0:1784044158.970732:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598736896 00000100:00100000:2.0:1784044158.971045:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044158.971056:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5773:x1870705598736896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784044158.971144:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5773:x1870705598736896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044158.971151:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784044158.971218:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed934700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598736896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784044158.971704:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1784044158.971784:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed934700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598737024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784044158.971825:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044158.972371:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc3822f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044158.972442:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598737024 00000100:00100000:1.0:1784044158.972448:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598737024 00000100:00100000:1.0:1784044158.972479:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784044158.972487:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5773:x1870705598737024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784044158.972844:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5773:x1870705598737024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 357us (1017us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1784044158.972851:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044158.973048:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed934700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1870705598737024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784044158.973102:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1784044158.973141:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.973152:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.973160:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.973178:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044158.973183:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.973191:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.973208:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bda59ac00) 00010000:00010000:3.0:1784044158.973210:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784044158.973215:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044158.973220:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550e3c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784044158.973389:0:5773:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784044158.973488:0:5773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1784044158.973500:0:5773:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336958634825ns, next at 337958632208ns, rc = 0 00000001:00080000:3.0:1784044158.973506:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1784044158.973714:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bda59ac00) 00010000:00010000:3.0:1784044158.973717:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784044158.973724:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead97a expref: 52 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044158.973849:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfecbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+51:11559:x1870705583020288:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 11570us (11823us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1784044158.973858:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00000020:00080000:3.0:1784044158.973861:0:5773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784044158.976574:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044158.976795:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583020544 00000100:00100000:1.0:1784044158.976814:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583020544 00000100:00100000:1.0:1784044158.976896:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 203 00000100:00100000:1.0:1784044158.976906:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+51:11559:x1870705583020544:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044158.977119:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044158.977140:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550e43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead981 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.977202:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550e43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead981 expref: 52 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.977215:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550e43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead981 expref: 52 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044158.977233:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044158.977236:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044158.977239:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc800, rc 0) 00000100:00100000:1.0:1784044158.977296:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:11559:x1870705583020544:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 391us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044158.977303:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 203 00000100:00100000:2.0:1784044158.981266:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044158.981391:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583020800 00000100:00100000:1.0:1784044158.981401:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583020800 00000100:00100000:1.0:1784044158.981454:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:1.0:1784044158.981464:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+52:11559:x1870705583020800:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044158.982338:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+53:11559:x1870705583020800:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 870us (1075us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1784044158.982347:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:3.0:1784044159.036936:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044159.037059:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583020928 00000100:00100000:0.0:1784044159.037070:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583020928 00000100:00100000:0.0:1784044159.037135:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 204 00000100:00100000:0.0:1784044159.037147:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+53:11569:x1870705583020928:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1784044159.037224:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037242:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037255:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037271:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037279:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037285:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037412:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037422:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037429:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044159.037474:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037487:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037495:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037501:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037507:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044159.037511:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037518:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037528:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044159.037531:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044159.037535:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037561:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037573:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037580:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037585:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037590:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044159.037594:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037600:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037618:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bda59a600) 00010000:00010000:0.0:1784044159.037620:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044159.037624:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037629:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037643:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037649:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037661:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037666:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044159.037669:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037676:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037685:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:0.0:1784044159.037688:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044159.037691:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.037697:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044159.037786:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+53:11569:x1870705583020928:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 641us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044159.037794:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 204 00000100:00100000:3.0:1784044159.083915:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044159.084026:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583021184 00000100:00100000:0.0:1784044159.084035:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583021184 00000100:00100000:0.0:1784044159.084093:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 205 00000100:00100000:0.0:1784044159.084102:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+53:11572:x1870705583021184:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044159.084121:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044159.084139:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead988 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084225:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084238:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084249:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084263:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084270:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084276:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084407:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550e74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084416:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084423:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044159.084433:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1784044159.084527:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084535:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084548:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084554:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044159.084558:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084566:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084579:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044159.084582:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044159.084587:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084594:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550e66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084606:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084611:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084617:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084621:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044159.084624:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084643:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084651:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bda59a600) 00010000:00010000:0.0:1784044159.084654:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044159.084657:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084663:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084701:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead988 expref: 56 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084713:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead988 expref: 55 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.084719:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:0.0:1784044159.084721:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044159.084724:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7200, rc 0) 00000100:00100000:0.0:1784044159.084797:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:11572:x1870705583021184:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 696us (892us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1784044159.084805:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 205 00000100:00100000:2.0:1784044159.097436:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044159.097612:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583021312 00000100:00100000:1.0:1784044159.097623:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583021312 00000100:00100000:1.0:1784044159.097683:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 206 00000100:00100000:1.0:1784044159.097693:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:11572:x1870705583021312:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1784044159.097776:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.097801:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.097814:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.097841:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.097849:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.097856:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.097912:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044159.097918:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.097926:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.097938:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044159.097942:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044159.097962:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.097969:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044159.098329:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:11572:x1870705583021312:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 635us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044159.098338:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 206 00000100:00100000:3.0:1784044159.105840:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044159.106030:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583021568 00000100:00100000:0.0:1784044159.106040:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583021568 00000100:00100000:0.0:1784044159.106106:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:0.0:1784044159.106117:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+55:11572:x1870705583021568:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044159.106372:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:11572:x1870705583021568:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 256us (542us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1784044159.106378:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:2.0:1784044159.241078:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044159.242348:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583021824 00000100:00100000:0.0:1784044159.242362:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583021824 00000100:00100000:0.0:1784044159.242600:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:0.0:1784044159.242613:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+56:11582:x1870705583021824:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044159.242637:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044159.242640:0:7482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784044159.242669:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7550e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead96c expref: 56 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.242695:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044159.242700:0:7482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044159.242714:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead98f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.242829:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.242842:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.242852:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044159.242861:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1784044159.243077:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550e89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead98f expref: 58 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.243107:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead98f expref: 57 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.243115:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:0.0:1784044159.243118:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044159.243121:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7e00, rc 0) 00000100:00100000:0.0:1784044159.243483:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:11582:x1870705583021824:12345-192.168.204.50@tcp:101:bash.0 Request processed in 871us (2414us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1784044159.243491:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:2.0:1784044159.249465:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044159.249517:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044159.249568:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583021952 00000100:00100000:0.0:1784044159.249580:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583021952 00000100:00100000:0.0:1784044159.249776:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:0.0:1784044159.249849:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:2347:x1870705583021952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1784044159.249911:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583022208 00010000:00010000:0.0:1784044159.249914:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784044159.249917:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583022208 00010000:00010000:0.0:1784044159.249944:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550e90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead98f expref: 58 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044159.249953:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 208 00000100:00100000:1.0:1784044159.249964:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:11582:x1870705583022208:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:0.0:1784044159.249970:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:0.0:1784044159.249976:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044159.250266:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+57:2347:x1870705583021952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 420us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044159.250276:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00010000:00010000:1.0:1784044159.251691:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044159.251724:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7550e74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead988 expref: 56 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.251752:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044159.251758:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044159.252301:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.252316:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.252326:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784044159.252378:0:5769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1784044159.252404:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d93ea548 reply state 00000000bc4b1a6f transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044159.252430:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044159.252586:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11582:x1870705583022208:12345-192.168.204.50@tcp:36:bash.0 Request processed in 2621us (3194us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1784044159.252595:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 208 00000020:00080000:1.0:1784044159.252602:0:5769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784044159.257642:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044159.257755:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583022336 00000100:00100000:0.0:1784044159.257767:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583022336 00000100:00100000:0.0:1784044159.257834:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:0.0:1784044159.257859:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11582:x1870705583022336:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044159.257902:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044159.257934:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ea5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead996 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.258035:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.258049:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.258057:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.258074:0:5770:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.258084:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.260310:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.260329:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.260337:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.260343:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044159.260348:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.260354:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.260371:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044159.260373:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044159.260377:0:3275:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.260386:0:3275:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.260393:0:3275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.260440:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.260446:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550e9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.261113:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.261124:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044159.261173:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784044159.261177:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044159.261197:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.261234:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ea5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead996 expref: 59 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.261260:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead996 expref: 58 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.261268:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:0.0:1784044159.261271:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044159.261273:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6400, rc 0) 00000100:00100000:0.0:1784044159.261340:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11582:x1870705583022336:12345-192.168.204.50@tcp:101:bash.0 Request processed in 3482us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044159.261348:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:3.0:1784044159.265410:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044159.265543:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583022592 00000100:00100000:0.0:1784044159.265555:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583022592 00000100:00100000:0.0:1784044159.265659:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:0.0:1784044159.265670:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+58:11582:x1870705583022592:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:0.0:1784044159.265962:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:11582:x1870705583022592:12345-192.168.204.50@tcp:35:bash.0 Request processed in 293us (561us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1784044159.265970:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:2.0:1784044159.331358:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044159.331455:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583022720 00000100:00100000:0.0:1784044159.331464:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583022720 00000100:00100000:0.0:1784044159.331516:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 210 00000100:00100000:0.0:1784044159.331525:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+59:11588:x1870705583022720:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044159.331559:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044159.331578:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550eb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead99d expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.331639:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550eba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.331667:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.331679:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044159.331749:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1784044159.331754:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044159.331778:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.332214:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550eb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead99d expref: 61 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.332235:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550eba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead99d expref: 60 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.332245:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:0.0:1784044159.332248:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044159.332251:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7e00, rc 0) 00000100:00100000:0.0:1784044159.332310:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:11588:x1870705583022720:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 785us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044159.332318:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 210 00000100:00100000:1.0:1784044159.340754:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044159.340896:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583022848 00000100:00100000:3.0:1784044159.340916:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583022848 00000100:00100000:3.0:1784044159.340976:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:3.0:1784044159.340986:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:11588:x1870705583022848:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044159.341016:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044159.341038:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9a4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341130:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550ec8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341145:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341156:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341171:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341178:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341184:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341293:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550ed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341302:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341310:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044159.341346:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1784044159.341350:0:7482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044159.341366:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341376:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341383:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341389:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550ec8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341395:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341401:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044159.341405:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341413:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341434:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044159.341437:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044159.341442:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550ec8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341448:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a800/0x9cc73983a7550ec8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341461:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341468:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ecf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341474:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341479:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044159.341482:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341489:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ecf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341495:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044159.341497:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044159.341499:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ecf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341505:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341543:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9be00/0x9cc73983a7550ec1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9a4 expref: 62 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341556:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9a4 expref: 61 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.341564:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:3.0:1784044159.341566:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044159.341568:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a000, rc 0) 00000100:00100000:3.0:1784044159.341628:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11588:x1870705583022848:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 643us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044159.341634:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:3.0:1784044159.350656:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044159.350752:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583022976 00000100:00100000:1.0:1784044159.350761:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583022976 00000100:00100000:1.0:1784044159.350838:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1784044159.350848:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:2348:x1870705583022976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044159.350892:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044159.350923:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a000/0x9cc73983a7550ed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9a4 expref: 61 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.350942:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044159.350945:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044159.350998:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:2348:x1870705583022976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 152us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044159.351498:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1784044159.351890:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044159.352396:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583023232 00000100:00100000:1.0:1784044159.352404:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583023232 00000100:00100000:1.0:1784044159.352453:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 212 00000100:00100000:1.0:1784044159.352462:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:11588:x1870705583023232:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044159.352482:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044159.352500:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550edd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9ab expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.352632:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.352647:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead996 expref: 61 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.352656:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.352691:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead996 expref: 61 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.352706:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead996 expref: 61 pid: 5770 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044159.352719:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598737152:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044159.353414:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5075780 going to sleep for 11 seconds 00000100:00100000:3.0:1784044159.357430:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044159.357505:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583023360 00000100:00100000:0.0:1784044159.357515:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583023360 00010000:00010000:0.0:1784044159.357566:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead996 expref: 62 pid: 5770 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044159.357610:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:0.0:1784044159.357630:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:2348:x1870705583023360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044159.357645:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044159.357652:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead996 expref: 62 pid: 5770 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.357664:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead996 expref: 62 pid: 5770 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.357687:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:0.0:1784044159.357692:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.357702:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.357712:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044159.357730:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044159.357799:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:2348:x1870705583023360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 170us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044159.357811:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00010000:00010000:1.0:1784044159.359214:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6400/0x9cc73983a7550eac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead996 expref: 61 pid: 5770 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044159.359237:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598737152:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044159.359259:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.359267:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.359291:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044159.359313:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784044159.359481:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550edd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ab expref: 62 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.359501:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ab expref: 61 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.359511:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044159.359514:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784044159.359517:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc000, rc 0) 00000100:00100000:1.0:1784044159.359590:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11588:x1870705583023232:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 7128us (7700us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1784044159.359599:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 212 00000100:00100000:0.0:1784044159.362410:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044159.362495:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583023616 00000100:00100000:1.0:1784044159.362504:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583023616 00000100:00100000:1.0:1784044159.362566:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1784044159.362576:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11588:x1870705583023616:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:1.0:1784044159.362592:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044159.362618:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550e43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead981 expref: 61 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044159.362639:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044159.362644:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044159.362718:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:11588:x1870705583023616:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 143us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044159.362726:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1784044159.365303:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044159.365392:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583023744 00000100:00100000:3.0:1784044159.365402:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583023744 00000100:00100000:3.0:1784044159.365503:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:3.0:1784044159.365514:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:11588:x1870705583023744:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:3.0:1784044159.365630:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.365647:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044159.365659:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044159.365927:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1784044159.366224:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:11588:x1870705583023744:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 709us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044159.366233:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:1.0:1784044159.368697:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044159.368788:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583023872 00000100:00100000:2.0:1784044159.368806:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583023872 00000100:00100000:2.0:1784044159.368857:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:2.0:1784044159.368894:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+60:11588:x1870705583023872:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1784044159.368943:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044159.368965:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550ef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9b2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044159.369032:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044159.369044:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550ef9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9b2 expref: 61 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044159.369063:0:5771:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044159.369075:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550ef9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9b2 expref: 61 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044159.369088:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:2.0:1784044159.369091:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044159.369094:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550ef9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9b2 expref: 61 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044159.369101:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4e00, rc 0) 00000100:00100000:2.0:1784044159.369151:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11588:x1870705583023872:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 286us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044159.369158:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:3.0:1784044159.390358:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598737280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044159.390445:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044159.391934:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598737280 00000100:00100000:0.0:1784044159.391946:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598737280 00000100:00100000:0.0:1784044159.392133:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784044159.392145:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1870705598737280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044159.392173:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044159.396051:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1870705598737280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3898us (5595us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044159.396079:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044159.396082:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598737280:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1784044159.429542:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1784044159.429691:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:2.0:1784044159.838308:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044159.867987:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044159.868034:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044159.868058:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044159.868177:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583024384 00000100:00100000:0.0:1784044159.868187:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583024384 00000100:00100000:0.0:1784044159.868252:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 152 00000100:00100000:0.0:1784044159.868280:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705583024384:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044159.868352:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705583024384:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044159.868360:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 152 00000100:00080000:0.0:1784044159.868406:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044159.868856:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044159.869051:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583024128 00000100:00100000:2.0:1784044159.869057:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583024128 00000100:00100000:2.0:1784044159.869111:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583024256 00000100:00100000:2.0:1784044159.869114:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583024256 00000100:00100000:2.0:1784044159.869132:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:2.0:1784044159.869140:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2347:x1870705583024128:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044159.869185:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2347:x1870705583024128:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 45us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044159.869192:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:2.0:1784044159.869205:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:2.0:1784044159.869211:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705583024256:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044159.869233:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705583024256:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 22us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044159.869239:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:3.0:1784044159.873896:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583024000 00000100:00100000:3.0:1784044159.873912:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583024000 00000100:00100000:3.0:1784044159.873985:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 297 00000100:00100000:3.0:1784044159.873997:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705583024000:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044159.874137:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705583024000:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 141us (6077us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044159.874145:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 297 00000040:00080000:0.0:1784044160.030640:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044160.030649:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044160.030685:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1784044160.030694:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044160.030836:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffd2e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598737408:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044160.032826:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc1682540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044160.041150:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffd2e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598737408:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784044160.041987:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044160.042208:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583024512 00000100:00100000:2.0:1784044160.042218:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583024512 00000100:00100000:2.0:1784044160.042309:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00100000:2.0:1784044160.042321:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11589:x1870705583024512:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784044160.042363:0:5771:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784044160.042491:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11589:x1870705583024512:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 171us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044160.042500:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00080000:0.0:1784044160.042837:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044160.052111:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044160.052187:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583024640 00000100:00100000:0.0:1784044160.052199:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583024640 00000100:00100000:0.0:1784044160.052277:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:0.0:1784044160.052290:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11589:x1870705583024640:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784044160.052385:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550f00 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052404:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550f00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052442:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550f00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052461:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550f07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052468:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550f07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052475:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550f07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052503:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052511:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052518:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044160.052565:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784044160.052570:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044160.052586:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052598:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550f00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052606:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550f00 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052624:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550f00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052631:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044160.052636:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550f00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052644:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550f00 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052658:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:0.0:1784044160.052661:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044160.052666:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550f00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052673:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a7550f00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052687:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550f07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052692:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550f07 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052699:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550f07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052703:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044160.052706:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550f07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052719:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550f07 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052741:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff904bda59ae00) 00010000:00010000:0.0:1784044160.052744:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044160.052748:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550f07 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052754:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7800/0x9cc73983a7550f07 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052769:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052775:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052781:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052786:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044160.052789:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052794:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052801:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:0.0:1784044160.052804:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044160.052806:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.052822:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7550f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044160.052956:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11589:x1870705583024640:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 668us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.052963:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:3.0:1784044160.066617:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044160.066748:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583024896 00000100:00100000:2.0:1784044160.066761:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583024896 00000100:00100000:2.0:1784044160.066848:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 217 00000100:00100000:2.0:1784044160.066860:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+61:11589:x1870705583024896:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044160.066951:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044160.066976:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f15 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9b9 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067105:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067123:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067138:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044160.067151:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784044160.067272:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067281:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067288:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067295:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044160.067301:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067309:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067322:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:2.0:1784044160.067331:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784044160.067337:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067344:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067394:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f15 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9b9 expref: 63 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067406:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:2.0:1784044160.067408:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044160.067413:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f15 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9b9 expref: 63 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.067423:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4200, rc 0) 00000100:00100000:2.0:1784044160.068103:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:11589:x1870705583024896:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1240us (1496us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1784044160.068114:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 217 00000100:00100000:2.0:1784044160.075987:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044160.076118:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583025024 00000100:00100000:0.0:1784044160.076131:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583025024 00000100:00100000:0.0:1784044160.076257:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 218 00000100:00100000:0.0:1784044160.076270:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:11589:x1870705583025024:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784044160.076319:0:5770:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784044160.076492:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:11589:x1870705583025024:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 222us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.076500:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 218 00000100:00100000:1.0:1784044160.080995:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044160.081105:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583025280 00000100:00100000:2.0:1784044160.081118:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583025280 00000100:00100000:2.0:1784044160.081193:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 219 00000100:00100000:2.0:1784044160.081204:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:11589:x1870705583025280:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044160.081231:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044160.081234:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784044160.081268:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550eba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead99d expref: 62 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.081307:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:2.0:1784044160.081313:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044160.081329:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550f2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9c0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784044160.081906:0:5769:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1784044160.082148:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550f31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.082164:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.082177:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.082235:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550f2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c0 expref: 64 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.082253:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c0 expref: 63 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.082262:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5800) 00010000:00010000:2.0:1784044160.082265:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044160.082268:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5800, rc 0) 00000100:00100000:2.0:1784044160.082347:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+63:11589:x1870705583025280:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1145us (1367us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1784044160.082357:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 219 00000100:00100000:1.0:1784044160.086229:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044160.086351:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583025536 00000100:00100000:3.0:1784044160.086364:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583025536 00000100:00100000:3.0:1784044160.086429:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 220 00000100:00100000:3.0:1784044160.086441:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+63:11589:x1870705583025536:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784044160.086516:0:7482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044160.086624:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7550f31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c0 expref: 63 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.086648:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5800) 00010000:00010000:3.0:1784044160.086678:0:7482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044160.086706:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550f3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.086722:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550f3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.086749:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550f3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087065:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x56cfb82c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087090:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x56cfb82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087103:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x56cfb82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087189:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550f3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087208:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550f3f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087214:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550f3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087221:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ae00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044160.087226:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550f3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087234:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550f3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087259:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044160.087262:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044160.087267:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550f3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087273:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ae00/0x9cc73983a7550f3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087285:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x56cfb82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087292:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56cfb82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087298:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56cfb82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087302:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9bc00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044160.087305:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56cfb82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087310:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56cfb82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087318:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x56cfb82c (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044160.087320:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044160.087323:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x56cfb82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.087328:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x56cfb82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044160.087457:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:11589:x1870705583025536:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1013us (1237us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044160.087468:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 220 00000100:00100000:0.0:1784044160.091310:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044160.091622:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583025664 00000100:00100000:2.0:1784044160.091638:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583025664 00000100:00100000:2.0:1784044160.091711:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 221 00000100:00100000:2.0:1784044160.091722:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+62:11589:x1870705583025664:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044160.091763:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044160.091793:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550f4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9c7 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.091837:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.091854:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.091918:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.092057:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550f4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c7 expref: 64 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.092080:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c7 expref: 63 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.092090:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5b00) 00010000:00010000:2.0:1784044160.092093:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784044160.092097:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4200, rc 0) 00000100:00100000:2.0:1784044160.092173:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+63:11589:x1870705583025664:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 453us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044160.092181:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 221 00000100:00100000:0.0:1784044160.097281:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044160.097592:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583025920 00000100:00100000:1.0:1784044160.097606:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583025920 00000100:00100000:1.0:1784044160.097674:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 222 00000100:00100000:1.0:1784044160.097685:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+63:11589:x1870705583025920:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784044160.097821:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.097844:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.097858:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044160.098202:0:5770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1784044160.098212:0:5770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338083347411ns, next at 339083344716ns, rc = 0 00000004:00010000:1.0:1784044160.098310:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc4e3463 reply state 0000000032571fdd transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044160.098336:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044160.098655:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+65:11589:x1870705583025920:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 968us (1384us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1784044160.098663:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 222 00010000:00010000:0.0:1784044160.102287:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.102307:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.102317:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.102325:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044160.102331:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.102684:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.102709:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5b00) 00010000:00010000:0.0:1784044160.102713:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784044160.102718:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.102735:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7550f5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044160.104640:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044160.104807:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583026048 00000100:00100000:3.0:1784044160.104823:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583026048 00000100:00100000:3.0:1784044160.105418:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 223 00000100:00100000:3.0:1784044160.105430:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+64:11589:x1870705583026048:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044160.105453:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044160.105473:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9ce expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.105533:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ce expref: 65 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.105547:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ce expref: 65 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.105564:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5b00) 00010000:00010000:3.0:1784044160.105567:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044160.105570:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9bc00, rc 0) 00000100:00100000:3.0:1784044160.105633:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+65:11589:x1870705583026048:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 206us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.105653:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 223 00000100:00100000:1.0:1784044160.109315:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044160.109472:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583026176 00000100:00100000:3.0:1784044160.109485:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583026176 00000100:00100000:3.0:1784044160.109600:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:3.0:1784044160.109630:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2348:x1870705583026176:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1784044160.110543:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:2348:x1870705583026176:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 910us (1737us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1784044160.110554:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00080000:0.0:1784044160.114139:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044160.115691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044160.116092:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583026432 00000100:00100000:2.0:1784044160.116106:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583026432 00000100:00100000:2.0:1784044160.116311:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:2.0:1784044160.116323:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+65:11589:x1870705583026432:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784044160.116652:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+66:11589:x1870705583026432:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 331us (971us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1784044160.116661:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:1.0:1784044160.120745:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044160.120834:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583026688 00000100:00100000:3.0:1784044160.120847:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583026688 00000100:00100000:3.0:1784044160.120952:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 224 00000100:00100000:3.0:1784044160.120965:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+66:11589:x1870705583026688:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784044160.121113:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+66:11589:x1870705583026688:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 150us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.121123:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 224 00000100:00100000:1.0:1784044160.125139:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044160.125452:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583026816 00000100:00100000:2.0:1784044160.125465:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583026816 00000100:00100000:2.0:1784044160.125540:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 225 00000100:00100000:2.0:1784044160.125551:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+66:11589:x1870705583026816:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044160.125576:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044160.125603:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550f69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9d5 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.125690:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.125707:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.125721:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044160.127088:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044160.127130:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.127277:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550f69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9d5 expref: 68 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.127304:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9d5 expref: 67 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.127314:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5b00) 00010000:00010000:3.0:1784044160.127317:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784044160.127321:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5000, rc 0) 00000100:00100000:3.0:1784044160.127461:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+67:11589:x1870705583026816:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1910us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.127494:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 225 00000100:00100000:0.0:1784044160.132416:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044160.132482:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583026944 00000100:00100000:1.0:1784044160.132495:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583026944 00000100:00100000:1.0:1784044160.132599:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:1.0:1784044160.132612:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+10:2347:x1870705583026944:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044160.132635:0:11907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044160.132661:0:11907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7550f77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9dc expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784044160.132698:0:11907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565a80, blocks: 0x1 00010000:00010000:1.0:1784044160.132721:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1784044160.132739:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044160.132753:0:11907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7550f77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9dc expref: 11 pid: 11907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.132776:0:11907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7550f77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9dc expref: 11 pid: 11907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.133247:0:11907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fd600, rc 0) 00000100:00100000:1.0:1784044160.133334:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+11:2347:x1870705583026944:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 725us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044160.133343:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:0.0:1784044160.136662:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044160.136765:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583027200 00000100:00100000:1.0:1784044160.136775:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583027200 00000100:00100000:1.0:1784044160.137127:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 226 00000100:00100000:1.0:1784044160.137139:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+67:11589:x1870705583027200:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784044160.137311:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+67:11589:x1870705583027200:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 174us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044160.137319:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 226 00000100:00100000:2.0:1784044160.140208:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044160.140363:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583027328 00000100:00100000:0.0:1784044160.140374:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583027328 00000100:00100000:0.0:1784044160.140437:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:0.0:1784044160.140447:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+11:11589:x1870705583027328:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044160.140467:0:8310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044160.140490:0:8310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9e3 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.140527:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7550f77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9dc expref: 12 pid: 11907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.140537:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044160.140559:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044160.140565:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 12 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.140607:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7550f77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9dc expref: 12 pid: 11907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.140622:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7550f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9dc expref: 12 pid: 11907 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044160.140638:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffd2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8310:1870705598737536:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044160.140753:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc1682540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044160.144284:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044160.144420:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583027456 00000100:00100000:2.0:1784044160.144431:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583027456 00010000:00010000:2.0:1784044160.144483:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7550f77 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9dc expref: 13 pid: 11907 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044160.144556:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:2.0:1784044160.144567:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:2348:x1870705583027456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044160.144586:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044160.144614:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7550f77 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9dc expref: 13 pid: 11907 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.144630:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7550f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9dc expref: 13 pid: 11907 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.144659:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044160.144664:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044160.144673:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 13 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.144685:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 13 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.144744:0:5756:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 13 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044160.144760:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5756:1870705598737664:192.168.204.50@tcp:105: 00000100:00100000:2.0:1784044160.144895:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb5d59c0 going to sleep for 11 seconds 00010000:00010000:1.0:1784044160.145043:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7550f77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9dc expref: 13 pid: 11907 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044160.145061:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffd2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8310:1870705598737536:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044160.145089:0:8310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 12 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.145100:0:8310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6a00, rc 0) 00000100:00100000:1.0:1784044160.145133:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+12:11589:x1870705583027328:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 4688us (4937us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044160.145141:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:0.0:1784044160.151343:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5756:1870705598737664:192.168.204.50@tcp:105: 00010000:00010000:0.0:1784044160.151380:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044160.151460:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+11:2348:x1870705583027456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6894us (7187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.151475:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:2.0:1784044160.153251:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044160.153474:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583027584 00000100:00100000:3.0:1784044160.153487:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583027584 00002000:00100000:3.0:1784044160.153695:0:6577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff904ac1dbdc00 x1870705583027584/t0(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:311/0 lens 504/0 e 0 to 0 dl 1784044171 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784044160.153708:0:6577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904ac1dbdc00 with x1870705583027584 ext(0->12) 00002000:00010000:3.0:1784044160.153716:0:6577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904ac1dbdc00 00000100:00100000:3.0:1784044160.153799:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1784044160.153810:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+11:2348:x1870705583027584:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784044160.154554:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:2348:x1870705583027584:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 743us (3401us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1784044160.154563:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00002000:00100000:3.0:1784044160.154572:0:6577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff904ac1dbdc00 x1870705583027584/t4294967321(0) o4->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:311/0 lens 504/448 e 0 to 0 dl 1784044171 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784044160.154581:0:6577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904ac1dbdc00 with x1870705583027584 ext(0->12) 00002000:00010000:3.0:1784044160.154585:0:6577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904ac1dbdc00 00000100:00100000:1.0:1784044160.157989:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044160.158152:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583027712 00000100:00100000:3.0:1784044160.158224:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583027712 00000100:00100000:3.0:1784044160.158304:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 227 00000100:00100000:3.0:1784044160.158315:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+67:11589:x1870705583027712:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1784044160.194390:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+67:11589:x1870705583027712:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 35548us (35887us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.194412:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 227 00000001:00080000:2.0:1784044160.196829:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000001:00080000:2.0:1784044160.196944:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1784044160.196951:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:0.0:1784044160.197465:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598737792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784044160.197556:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1784044160.197905:0:5791:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff904bc7e47600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1784044160.197910:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bc7d3cb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff904bc7e47b40 00000020:00080000:2.0:1784044160.197914:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bc7d3cf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff904bffaaf800 00000001:00080000:2.0:1784044160.197937:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:2.0:1784044160.197970:0:5791:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1784044160.197982:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1784044160.198013:0:5791:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff904bc3822240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1784044160.198017:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bfb345500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff904bc3822000 00000020:00080000:2.0:1784044160.198020:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bfb345700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff904bffbc8c00 00000004:00080000:2.0:1784044160.198031:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:2.0:1784044160.198074:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598737792 00000100:00100000:2.0:1784044160.198084:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598737792 00000100:00100000:2.0:1784044160.198162:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784044160.198182:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598737792:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1784044160.198320:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00002000:00080000:2.0:1784044160.198430:0:6572:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1784044160.198571:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.198600:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e313690/0x9cc73983a7550d47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead942 expref: 12 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.198611:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784044160.198617:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044160.198622:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.198675:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e313690/0x9cc73983a7550d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead942 expref: 12 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.198692:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e313690/0x9cc73983a7550d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead942 expref: 12 pid: 11907 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044160.198707:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6572:1870705598738048:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044160.198805:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb5d56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044160.199169:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044160.199181:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598737920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784044160.199229:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044160.199426:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000020:00080000:1.0:1784044160.199530:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1784044160.199636:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598737920 00000100:00100000:3.0:1784044160.199645:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598737920 00000100:00100000:3.0:1784044160.199700:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583027840 00000100:00100000:3.0:1784044160.199704:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583027840 00000100:00100000:3.0:1784044160.199733:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044160.199743:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3290:x1870705598737920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1784044160.200030:0:11907:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1784044160.200034:0:11907:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1784044160 00002000:00010000:3.0:1784044160.200037:0:11907:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784044160.200040:0:11907:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1784044160 -> 1784044160 00002000:00010000:3.0:1784044160.200042:0:11907:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784044160.200094:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3290:x1870705598737920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 352us (864us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1784044160.200102:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044160.200123:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:3.0:1784044160.200132:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:2345:x1870705583027840:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1784044160.200268:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044160.200281:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598738176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784044160.200319:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044160.200344:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598738176 00000100:00100000:2.0:1784044160.200348:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598738176 00000100:00100000:2.0:1784044160.200374:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784044160.200381:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598738176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784044160.200396:0:6569:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1784044160.200427:0:6569:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a565a7f, atime: 0x6a565a7f, ctime: 0x6a565a7f, blocks: 0xb 00010000:00010000:2.0:1784044160.200435:0:6569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550f8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.200450:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1784044160.200454:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044160.200462:0:6569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550f8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784044160.200474:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904bed936d80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1784044160.200483:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598737920:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1784044160.200504:0:6569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550f8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.200519:0:6569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550f8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.200526:0:6569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550f8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.200557:0:6569:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044160.201496:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044160.201508:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550f8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.201519:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044160.201524:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550f8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.201536:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550f8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.201558:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550f8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.201567:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff91b1f/0x9cc73983a7550f8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.201592:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044160.201594:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044160.201596:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044160.202174:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044160.202182:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044160.203749:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598738176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3358us (3419us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784044160.203765:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784044160.203832:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1784044160.203840:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904bff552300, transno 4294967307 00000004:00080000:2.0:1784044160.203853:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1784044160.203916:0:3289:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff904ac1dbc380 x1870705598738176/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784044176 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1784044160.203931:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904ac1dbc380/2, rc 0, transno 4294967310 00000100:00100000:2.0:1784044160.203939:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598738176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784044160.206306:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6572:1870705598738048:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044160.206343:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044160.214428:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044160.215255:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583027968 00000100:00100000:1.0:1784044160.215280:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583027968 00010000:00010000:1.0:1784044160.215330:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e313690/0x9cc73983a7550d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead942 expref: 14 pid: 11907 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044160.215390:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:1.0:1784044160.215400:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+14:2346:x1870705583027968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044160.215420:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044160.215426:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e313690/0x9cc73983a7550d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead942 expref: 14 pid: 11907 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.215442:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e313690/0x9cc73983a7550d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead942 expref: 14 pid: 11907 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.215473:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e313690/0x9cc73983a7550d47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead942 expref: 14 pid: 11907 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.215494:0:8289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044160.215500:0:8289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044160.215507:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.215519:0:8289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.215738:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044160.215964:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+13:2346:x1870705583027968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 464us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044160.215987:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00010000:00010000:0.0:1784044160.216130:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.216143:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.216155:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.216174:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.216197:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044160.218320:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044160.218335:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.218350:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044160.218355:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.218367:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.218392:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.218401:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ff220a/0x9cc73983a7550f85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.218425:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044160.218426:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044160.218428:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044160.220118:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3290:x1870705598737792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21924us (22547us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1784044160.220135:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1784044160.221146:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904bed937480/2, rc 0, transno 4294967323 00000100:00100000:0.0:1784044160.221223:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598737792:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1784044160.241370:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1784044160.241402:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1784044160.241415:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:0.0:1784044160.241429:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1784044160.241436:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1784044160.241581:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2345:x1870705583027840:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 41441us (42147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.241594:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:0.0:1784044160.245612:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044160.245803:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583028224 00000100:00100000:3.0:1784044160.245818:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583028224 00000100:00100000:3.0:1784044160.245929:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 228 00000100:00100000:3.0:1784044160.245941:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:11589:x1870705583028224:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784044160.246173:0:7482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044160.246211:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a7550f70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9d5 expref: 20 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.246237:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5b00) 00010000:00010000:3.0:1784044160.246243:0:7482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044160.246281:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.246303:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.246315:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044160.246643:0:7482:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000072159500 reply state 00000000fe99d165 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044160.246655:0:7482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784044160.246793:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:11589:x1870705583028224:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 853us (1194us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1784044160.246801:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 228 00010000:00010000:1.0:1784044160.250196:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.250221:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.250230:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.250256:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044160.250262:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.250271:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.250293:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5b00) 00010000:00010000:1.0:1784044160.250297:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044160.250301:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.250309:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550f93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044160.251284:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044160.251406:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583028352 00000100:00100000:1.0:1784044160.251419:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583028352 00000100:00100000:1.0:1784044160.251485:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:1.0:1784044160.251495:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb6ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2348:x1870705583028352:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784044160.251823:0:8310:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1784044160.251827:0:8310:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1784044160 -> 1784044159 00002000:00010000:1.0:1784044160.251830:0:8310:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1784044159 00002000:00010000:1.0:1784044160.251833:0:8310:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1784044160 -> 1784044159 00002000:00010000:1.0:1784044160.251836:0:8310:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1784044160.252220:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb6ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2348:x1870705583028352:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 665us (886us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1784044160.252232:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:0.0:1784044160.256209:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044160.256338:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583028608 00000100:00100000:1.0:1784044160.256367:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583028608 00000100:00100000:1.0:1784044160.256437:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:1.0:1784044160.256449:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:11589:x1870705583028608:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784044160.256537:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.256558:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c7 expref: 20 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.256569:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.256609:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c7 expref: 20 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.256624:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c7 expref: 20 pid: 5769 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044160.256643:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beee39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598738304:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044160.256753:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5075780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044160.260707:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044160.260847:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beee39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1870705598738304:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044160.260924:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044160.261178:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583028736 00000100:00100000:0.0:1784044160.261188:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583028736 00010000:00010000:0.0:1784044160.261232:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c7 expref: 21 pid: 5769 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044160.261277:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:0.0:1784044160.261287:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:2348:x1870705583028736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044160.261305:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044160.261312:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c7 expref: 21 pid: 5769 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.261326:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c7 expref: 21 pid: 5769 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.261352:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7550f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9c7 expref: 21 pid: 5769 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.261371:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5b00) 00010000:00010000:0.0:1784044160.261375:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.261386:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.261395:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.261445:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044160.261509:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:2348:x1870705583028736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 223us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.261517:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00010000:00010000:1.0:1784044160.261669:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.261678:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.261738:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.261747:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.261755:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.261762:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044160.261767:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.261776:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.261792:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5b00) 00010000:00010000:1.0:1784044160.261795:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784044160.261799:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.261806:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550f9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044160.261855:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:11589:x1870705583028608:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 5408us (5660us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784044160.261915:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:0.0:1784044160.265344:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044160.265525:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583028864 00000100:00100000:2.0:1784044160.265538:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583028864 00000100:00100000:2.0:1784044160.265632:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:2.0:1784044160.265644:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705583028864:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784044160.265739:0:6569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.265766:0:6569:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 8 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.265776:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044160.265781:0:6569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044160.265795:0:6569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.265842:0:6569:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 8 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.265858:0:6569:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 8 pid: 8310 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044160.265914:0:6569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6569:1870705598738432:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044160.266055:0:6569:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb5d5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044160.271576:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044160.271654:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583028992 00000100:00100000:0.0:1784044160.271667:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583028992 00010000:00010000:0.0:1784044160.271721:0:5757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 9 pid: 8310 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044160.271789:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:0.0:1784044160.271800:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2347:x1870705583028992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044160.271820:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044160.271853:0:5757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 9 pid: 8310 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.271905:0:5757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 9 pid: 8310 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.271937:0:5757:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044160.271942:0:5757:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044160.271950:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.271964:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.272086:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044160.272155:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2347:x1870705583028992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 355us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.272333:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00010000:00010000:2.0:1784044160.272489:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7550f7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9e3 expref: 8 pid: 8310 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044160.272508:0:6569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6569:1870705598738432:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044160.272534:0:6569:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.272560:0:6569:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.272569:0:6569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.272601:0:6569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.272610:0:6569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.272620:0:6569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.272627:0:6569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044160.272631:0:6569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.272642:0:6569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.272655:0:6569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.272673:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7550fa1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044160.272741:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705583028864:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 7099us (7410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044160.272750:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:3.0:1784044160.277265:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044160.277355:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583029248 00000100:00100000:1.0:1784044160.277368:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583029248 00000100:00100000:1.0:1784044160.277436:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 230 00000100:00100000:1.0:1784044160.277464:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:11589:x1870705583029248:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784044160.277645:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fa8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.277667:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.277682:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.278326:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.278342:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ce expref: 20 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.278351:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.278394:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ce expref: 20 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.278412:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ce expref: 20 pid: 5771 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044160.278428:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beee39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598738560:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044160.278794:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5075780 going to sleep for 11 seconds 00000100:00100000:3.0:1784044160.285156:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044160.285316:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583029376 00000100:00100000:0.0:1784044160.285328:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583029376 00010000:00010000:0.0:1784044160.285377:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f62 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ce expref: 21 pid: 5771 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044160.285451:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:0.0:1784044160.285462:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed934a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:2348:x1870705583029376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044160.285481:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044160.285489:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f62 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ce expref: 21 pid: 5771 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.285505:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ce expref: 21 pid: 5771 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.285532:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5b00) 00010000:00010000:0.0:1784044160.285548:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.285559:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.285569:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.285609:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044160.285679:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed934a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:2348:x1870705583029376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 218us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.285688:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00010000:00010000:1.0:1784044160.286104:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9bc00/0x9cc73983a7550f62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ce expref: 20 pid: 5771 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044160.286139:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beee39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598738560:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044160.286173:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.286183:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.286190:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784044160.286468:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1784044160.286644:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1784044160.286689:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1784044160.286791:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beee39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5770:1870705598738688:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784044160.286853:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044160.286917:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5075d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044160.286945:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598738688 00000100:00100000:1.0:1784044160.286951:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598738688 00000100:00100000:1.0:1784044160.286993:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044160.287001:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5770:x1870705598738688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784044160.287075:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5770:x1870705598738688:12345-0@lo:1000:mdt00_001.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044160.287083:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044160.287113:0:5770:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1784044160.287119:0:5770:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1784044160.287137:0:5770:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904bed936d80, transno 4294967322 00000100:00100000:1.0:1784044160.287153:0:5770:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff904bed937480 x1870705598737792/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784044176 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044160.287175:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beee39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5770:1870705598738688:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1784044160.287614:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1784044160.287666:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5770:1870705598738816:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784044160.287693:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044160.287714:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5075780 going to sleep for 11 seconds 00000100:00100000:1.0:1784044160.289676:0:11851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598738816 00000100:00100000:1.0:1784044160.289693:0:11851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598738816 00000100:00100000:1.0:1784044160.289797:0:11851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044160.289808:0:11851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5770:x1870705598738816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784044160.290302:0:11851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5770:x1870705598738816:12345-0@lo:1000:mdt00_001.0 Request processed in 494us (2606us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1784044160.290311:0:11851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044160.290381:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5770:1870705598738816:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1784044160.290430:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290441:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290450:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290457:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044160.290462:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290471:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290510:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bd19d5b00) 00010000:00010000:1.0:1784044160.290513:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044160.290519:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290526:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a7550faf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290566:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290573:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290580:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290585:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9a200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044160.290587:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290594:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290601:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044160.290603:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044160.290612:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550ef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9b2 expref: 23 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290626:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550ef9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9b2 expref: 23 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290641:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9b2 expref: 23 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.290681:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9b2 expref: 23 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044160.290697:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff50e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598738944:192.168.204.50@tcp:105: 00000100:00100000:1.0:1784044160.291336:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5a62000 going to sleep for 11 seconds 00000100:00100000:3.0:1784044160.295241:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044160.295391:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff50e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1870705598738944:192.168.204.50@tcp:105: 00010000:00010000:1.0:1784044160.295426:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295439:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a200/0x9cc73983a7550ef2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295480:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7550fb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295499:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7550fb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295513:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7550fb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295525:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7550fb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295532:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7550fb6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295558:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7550fb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295564:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fdc00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044160.295569:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7550fb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295577:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7550fb6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295589:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044160.295592:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044160.295595:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7550fb6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295601:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7550fb6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295616:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295622:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fa8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295628:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295633:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044160.295636:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295649:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fa8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295657:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044160.295660:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784044160.295663:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fa8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.295668:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fa8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044160.296182:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:11589:x1870705583029248:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 18716us (18928us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1784044160.296194:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 230 00000020:00080000:1.0:1784044160.296201:0:5770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1784044160.296344:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583029504 00000100:00100000:0.0:1784044160.296354:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583029504 00000100:00100000:0.0:1784044160.296412:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:0.0:1784044160.296423:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:11588:x1870705583029504:12345-192.168.204.50@tcp:49:lfs.0 00000100:00100000:0.0:1784044160.296534:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:11588:x1870705583029504:12345-192.168.204.50@tcp:49:lfs.0 Request processed in 113us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.296541:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000040:00080000:3.0:1784044160.296757:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044160.296763:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044160.298645:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1784044160.298667:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784044160.301663:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044160.302282:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583029760 00000100:00100000:3.0:1784044160.302297:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583029760 00000100:00100000:3.0:1784044160.302374:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 231 00000100:00100000:3.0:1784044160.302385:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:11588:x1870705583029760:12345-192.168.204.50@tcp:58:lfs.0 00000040:00080000:2.0:1784044160.303261:0:5771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1784044160.303380:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:11588:x1870705583029760:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 994us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044160.303390:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 231 00000100:00100000:2.0:1784044160.312812:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044160.312926:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583030016 00000100:00100000:0.0:1784044160.312938:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583030016 00000100:00100000:0.0:1784044160.313017:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1784044160.313029:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfec8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+23:11589:x1870705583030016:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784044160.313832:0:5773:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784044160.314008:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1784044160.314064:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.314084:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.314098:0:5773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.314108:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.314123:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.314129:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044160.314159:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784044160.314276:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfec8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+25:11589:x1870705583030016:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 1245us (1474us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1784044160.314285:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000020:00080000:0.0:1784044160.314291:0:5773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784044160.314546:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044160.314556:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.314575:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044160.314580:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.314589:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.314603:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff904bda59ae00) 00010000:00010000:3.0:1784044160.314611:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784044160.314616:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.314623:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7550fbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.314641:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044160.314643:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044160.314645:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044160.357448:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044160.357561:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583030144 00000100:00100000:3.0:1784044160.357575:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583030144 00000100:00100000:3.0:1784044160.357651:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 232 00000100:00100000:3.0:1784044160.357663:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+25:11591:x1870705583030144:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044160.357694:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044160.357731:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9ea expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.357813:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550fcb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.357858:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044160.358032:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.359891:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550fd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.359918:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.359932:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.360989:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.361013:0:7482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ab expref: 26 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.361024:0:7482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.361082:0:7482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ab expref: 26 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.361104:0:7482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ab expref: 26 pid: 5769 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044160.361122:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf56c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598739072:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044160.361833:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb5d5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044160.364150:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf56c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7482:1870705598739072:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044160.364188:0:7482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044160.365604:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044160.365700:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583030400 00000100:00100000:3.0:1784044160.365712:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583030400 00000100:00100000:3.0:1784044160.365795:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:3.0:1784044160.365807:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:5565:x1870705583030400:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784044160.366172:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:5565:x1870705583030400:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 366us (576us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1784044160.366181:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:2.0:1784044160.368464:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044160.368558:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583030528 00000100:00100000:1.0:1784044160.368569:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583030528 00010000:00010000:1.0:1784044160.368615:0:8289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ab expref: 28 pid: 5769 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044160.368661:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:1.0:1784044160.368671:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:2347:x1870705583030528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044160.368687:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044160.368695:0:8289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ab expref: 28 pid: 5769 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.368710:0:8289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ab expref: 28 pid: 5769 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.368769:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ee4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ab expref: 28 pid: 5769 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.368793:0:8289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044160.368799:0:8289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.368810:0:8289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.368819:0:8289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044160.368992:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044160.369088:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+27:2347:x1870705583030528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 417us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044160.369097:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00010000:00010000:2.0:1784044160.369190:0:7482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369198:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044160.369251:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784044160.369256:0:7482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044160.369278:0:7482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369292:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369303:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369309:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550fcb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369317:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369331:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bffa9ba00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044160.369336:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369345:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550fcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369355:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:2.0:1784044160.369358:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044160.369362:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550fcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369368:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9ba00/0x9cc73983a7550fcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369381:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369387:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369393:0:7482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369399:0:7482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044160.369401:0:7482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369406:0:7482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369423:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff904bd19d5d00) 00010000:00010000:2.0:1784044160.369425:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044160.369429:0:7482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550fd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369435:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7550fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369472:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9a400/0x9cc73983a7550fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ea expref: 27 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369486:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ea expref: 26 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044160.369494:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:2.0:1784044160.369497:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044160.369499:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5200, rc 0) 00000100:00100000:2.0:1784044160.369526:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:11591:x1870705583030144:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 11867us (12095us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044160.369533:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 232 00010000:00010000:2.0:1784044160.865066:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044161.172716:0:12456:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044161.172729:0:12456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044161.173404:0:12456:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784044161.173411:0:12456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1784044161.310493:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044161.310505:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044161.310625:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784044161.310632:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784044161.310804:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff550a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598739200:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784044161.311231:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc380fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044161.322568:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff550a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1870705598739200:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044161.347420:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044161.347475:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583030656 00000100:00100000:0.0:1784044161.347487:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583030656 00000100:00100000:0.0:1784044161.347556:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 233 00000100:00100000:0.0:1784044161.347568:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:11604:x1870705583030656:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784044161.347614:0:5769:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784044161.349430:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:11604:x1870705583030656:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 1851us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044161.349444:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 233 00000100:00100000:2.0:1784044161.380508:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044161.380712:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583030912 00000100:00100000:1.0:1784044161.380724:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583030912 00000100:00100000:1.0:1784044161.380858:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 234 00000100:00100000:1.0:1784044161.381674:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+26:11604:x1870705583030912:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044161.381714:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044161.381743:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550fe0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9f1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044161.382409:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044161.382453:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044161.382469:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044161.382484:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784044161.384056:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550fe0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9f1 expref: 29 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044161.384095:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9f1 expref: 28 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044161.384106:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044161.384109:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044161.384113:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fd600, rc 0) 00000100:00100000:1.0:1784044161.384217:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:11604:x1870705583030912:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 2557us (3723us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1784044161.384228:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 234 00000100:00100000:3.0:1784044161.390772:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044161.390925:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583031168 00000100:00100000:0.0:1784044161.390939:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583031168 00000100:00100000:0.0:1784044161.391028:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 235 00000100:00100000:0.0:1784044161.391041:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+28:11604:x1870705583031168:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784044161.391159:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ff5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044161.391183:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044161.391199:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044161.391441:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044161.391449:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ff5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044161.391458:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044161.391465:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044161.391471:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044161.391480:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ff5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044161.391528:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:0.0:1784044161.391532:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044161.391538:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ff5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044161.391545:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7550ff5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044161.391747:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:11604:x1870705583031168:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 707us (995us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1784044161.391758:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 235 00000040:00080000:1.0:1784044161.391935:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784044161.391942:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044161.392726:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784044161.392737:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044161.397146:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044161.397199:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044161.397344:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583031296 00000100:00100000:3.0:1784044161.397350:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583031552 00000100:00100000:2.0:1784044161.397356:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583031296 00000100:00100000:3.0:1784044161.397357:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583031552 00000100:00100000:3.0:1784044161.397430:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:2.0:1784044161.397435:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:3.0:1784044161.397445:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:11604:x1870705583031552:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784044161.397448:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+30:2348:x1870705583031296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044161.397472:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044161.397513:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7550fe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9f1 expref: 30 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044161.397541:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:2.0:1784044161.397547:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044161.397618:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:2348:x1870705583031296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 174us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044161.397627:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:3.0:1784044161.397727:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:11604:x1870705583031552:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 286us (526us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1784044161.397734:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00010000:00010000:3.0:1784044161.886529:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044162.398376:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044162.398390:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044162.398434:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784044162.398441:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784044162.911963:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044163.212545:0:12508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044163.212557:0:12508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044163.212607:0:12508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784044163.212613:0:12508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044163.463135:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044163.463306:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583031808 00000100:00100000:1.0:1784044163.463319:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583031808 00000100:00100000:1.0:1784044163.463417:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 236 00000100:00100000:1.0:1784044163.463431:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+29:11624:x1870705583031808:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044163.463486:0:7482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044163.463515:0:7482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ffc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9f8 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044163.463657:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7551003 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044163.463687:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7551003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044163.463702:0:7482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7551003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044163.463716:0:7482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784044163.463921:0:7482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7550ffc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9f8 expref: 32 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044163.463945:0:7482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7551003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9f8 expref: 31 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044163.463955:0:7482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:1.0:1784044163.463958:0:7482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784044163.463962:0:7482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fdc00, rc 0) 00000100:00100000:1.0:1784044163.464034:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:11624:x1870705583031808:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 606us (914us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1784044163.464042:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 236 00000100:00080000:0.0:1784044163.464236:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044163.469015:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044163.469132:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583031936 00000100:00100000:0.0:1784044163.469145:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583031936 00000100:00100000:0.0:1784044163.469219:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 237 00000100:00100000:0.0:1784044163.469231:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:11624:x1870705583031936:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:0.0:1784044163.469322:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044163.469351:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044163.469388:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044163.469424:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044163.469432:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551011 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044163.469439:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044163.469446:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044163.469451:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044163.469458:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551011 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044163.469470:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:0.0:1784044163.469473:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044163.469478:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551011 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044163.469484:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044163.469580:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:11624:x1870705583031936:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 351us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044163.469590:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 237 00000100:00100000:0.0:1784044163.640684:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044163.640811:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583032064 00000100:00100000:2.0:1784044163.640824:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583032064 00000100:00100000:2.0:1784044163.640931:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:2.0:1784044163.640946:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2345:x1870705583032064:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1784044163.640969:0:11907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044163.640997:0:11907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7551018 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1ead9ff expref: -99 pid: 11907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044163.641043:0:11907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a565a7f, atime: 0x6a565a7f, ctime: 0x6a565a7f, blocks: 0xb 00010000:00010000:2.0:1784044163.641073:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1784044163.641079:0:11907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044163.641092:0:11907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7551018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ff expref: 8 pid: 11907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044163.641130:0:11907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7551018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ff expref: 8 pid: 11907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044163.641149:0:11907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4000, rc 0) 00000100:00100000:2.0:1784044163.641305:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2345:x1870705583032064:12345-192.168.204.50@tcp:101:cat.0 Request processed in 363us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044163.641314:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00080000:0.0:1784044163.641629:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044163.646526:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044163.648424:0:11829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583032192 00000100:00100000:3.0:1784044163.648444:0:11829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583032192 00002000:00100000:3.0:1784044163.648537:0:11829:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff904beb0f3b80 x1870705583032192/t0(0) o3->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:314/0 lens 488/0 e 0 to 0 dl 1784044174 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784044163.648573:0:11829:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904beb0f3b80 with x1870705583032192 ext(0->4095) 00002000:00010000:3.0:1784044163.648582:0:11829:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904beb0f3b80 00000100:00100000:3.0:1784044163.648633:0:11829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1784044163.648644:0:11829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2346:x1870705583032192:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1784044163.648983:0:11829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2346:x1870705583032192:12345-192.168.204.50@tcp:3:cat.0 Request processed in 338us (2470us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1784044163.648992:0:11829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00002000:00100000:3.0:1784044163.648999:0:11829:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff904beb0f3b80 x1870705583032192/t0(0) o3->3609c122-577c-43fa-ab52-dd2c7dc5cce7@192.168.204.50@tcp:314/0 lens 488/4536 e 0 to 0 dl 1784044174 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784044163.649006:0:11829:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff904beb0f3b80 with x1870705583032192 ext(0->4095) 00002000:00010000:3.0:1784044163.649010:0:11829:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff904beb0f3b80 00010000:00010000:3.0:1784044163.935231:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044163.998402:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598739328:0@lo:400:kworker.0 00000100:00100000:2.0:1784044163.998508:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044163.998558:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598739712:0@lo:400:kworker.0 00000100:00100000:2.0:1784044163.998600:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598739584:0@lo:400:kworker.0 00000100:00100000:1.0:1784044163.998632:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044163.998641:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044163.998796:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bed935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598739456:0@lo:400:kworker.0 00000100:00100000:3.0:1784044163.998810:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598739840:0@lo:400:kworker.0 00000100:00100000:1.0:1784044164.002271:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598739328 00000100:00100000:1.0:1784044164.002295:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598739328 00000100:00100000:1.0:1784044164.002374:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1784044164.002388:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598739328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044164.002509:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3289:x1870705598739328:12345-0@lo:400:kworker.0 Request processed in 124us (4001us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044164.002518:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1784044164.002566:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598739584 00000100:00100000:1.0:1784044164.002571:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598739584 00000100:00100000:1.0:1784044164.002657:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784044164.002665:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598739584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044164.002715:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598739584:12345-0@lo:400:kworker.0 Request processed in 52us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044164.002722:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1784044164.002888:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044164.002923:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044164.002935:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598739584:0@lo:400:kworker.0 00000100:00100000:0.0:1784044164.002961:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598739456 00000100:00100000:0.0:1784044164.002966:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598739456 00000100:00100000:2.0:1784044164.002992:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598739968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044164.003040:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044164.003067:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598739968 00000100:00100000:2.0:1784044164.003071:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598739968 00000100:00100000:2.0:1784044164.003113:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784044164.003140:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beee41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1870705598739968:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044164.003201:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598739712 00000100:00100000:0.0:1784044164.003202:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784044164.003208:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598739712 00000100:00100000:0.0:1784044164.003214:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598739456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044164.003246:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784044164.003255:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3288:x1870705598739712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044164.003270:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598739456:12345-0@lo:400:kworker.0 Request processed in 57us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044164.003277:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784044164.003309:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3288:x1870705598739712:12345-0@lo:400:kworker.0 Request processed in 55us (4678us total) trans 0 rc 0/0 00000100:00080000:0.0:1784044164.003312:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044164.003317:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784044164.003355:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598739712:0@lo:400:kworker.0 00000100:00100000:0.0:1784044164.003635:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598739456:0@lo:400:kworker.0 00000100:00100000:0.0:1784044164.003645:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598740096:0@lo:400:kworker.0 00000100:00100000:0.0:1784044164.003688:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1784044164.003825:0:6574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044164.003838:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598740096 00000100:00100000:1.0:1784044164.003845:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598740096 00000100:00100000:2.0:1784044164.003901:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beee41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1870705598739968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 761us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044164.003912:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784044164.003913:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784044164.003923:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598740096:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784044164.004117:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044164.004141:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598740096:0@lo:400:kworker.0 00000100:00100000:1.0:1784044164.004200:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1870705598740096:12345-0@lo:400:kworker.0 Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044164.004209:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598739968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044164.004210:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784044164.005072:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044164.005861:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bed935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598739328:0@lo:400:kworker.0 00000100:00100000:1.0:1784044164.009271:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598739840 00000100:00100000:1.0:1784044164.009293:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598739840 00000100:00100000:1.0:1784044164.009446:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784044164.009461:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598739840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044164.009592:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598739840:12345-0@lo:400:kworker.0 Request processed in 135us (4523us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044164.009601:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784044164.009950:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598739840:0@lo:400:kworker.0 00000100:00080000:2.0:1784044164.010214:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044164.510380:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044164.510415:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598740224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044164.510519:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044164.510803:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598740224 00000100:00100000:1.0:1784044164.510814:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598740224 00000100:00100000:1.0:1784044164.510918:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784044164.510929:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598740224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044164.510985:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044164.511054:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598740224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044164.511061:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784044164.511196:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598740224:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1784044164.642815:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1784044164.959488:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044165.002856:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044165.002912:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044165.002951:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044165.002982:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044165.003005:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044165.003044:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583032832 00000100:00100000:3.0:1784044165.003054:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583032832 00000100:00100000:1.0:1784044165.003228:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583032576 00000100:00100000:1.0:1784044165.003233:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583032576 00000100:00100000:1.0:1784044165.003288:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583032704 00000100:00100000:1.0:1784044165.003292:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583032704 00000100:00100000:1.0:1784044165.003319:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:1.0:1784044165.003331:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705583032576:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044165.003426:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+8:2347:x1870705583032576:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 96us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044165.003434:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:1.0:1784044165.003457:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:1.0:1784044165.003463:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705583032704:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044165.003489:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705583032704:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044165.003495:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00080000:1.0:1784044165.003510:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044165.003514:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044165.004753:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583032448 00000100:00100000:3.0:1784044165.004764:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583032448 00000100:00100000:3.0:1784044165.004793:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 156 00000100:00100000:3.0:1784044165.004801:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705583032832:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044165.004853:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705583032832:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 52us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044165.004860:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 156 00000100:00100000:3.0:1784044165.004887:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 157 00000100:00100000:3.0:1784044165.004893:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:2347:x1870705583032448:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044165.004920:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+31:2347:x1870705583032448:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044165.004926:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 157 00000100:00080000:1.0:1784044165.005711:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044165.008072:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583032320 00000100:00100000:0.0:1784044165.008094:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583032320 00000100:00100000:0.0:1784044165.008193:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 299 00000100:00100000:0.0:1784044165.008207:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705583032320:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044165.008332:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705583032320:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 127us (5487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044165.008359:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 299 00000001:00080000:0.0:1784044165.603301:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1784044165.603318:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1784044165.603324:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1784044165.606673:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1784044165.606691:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1784044165.606703:0:5791:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff904bc5075c00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1784044165.606709:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bc7d3c300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff904bd00bfc00 00000020:00080000:3.0:1784044165.606713:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff904bc7d3c200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff904bffc98c00 00000020:00080000:3.0:1784044165.606730:0:5791:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1784044165.606780:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1784044165.607017:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1784044165.985560:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044167.006454:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044168.030981:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044169.054501:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044169.119077:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598740480:0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.119155:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044169.119210:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598740992:0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.119239:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044169.119283:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044169.119289:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598740608:0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.119327:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044169.119364:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598740480 00000100:00100000:3.0:1784044169.119371:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598740480 00000100:00100000:3.0:1784044169.119417:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598740608 00000100:00100000:3.0:1784044169.119420:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598740608 00000100:00100000:3.0:1784044169.119452:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784044169.119460:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598740480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.119513:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598740480:12345-0@lo:400:kworker.0 Request processed in 53us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044169.119521:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784044169.119537:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784044169.119544:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598740608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.119581:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598740608:12345-0@lo:400:kworker.0 Request processed in 37us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044169.119586:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784044169.119603:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598740992 00000100:00100000:3.0:1784044169.119607:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598740992 00000100:00100000:3.0:1784044169.119645:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784044169.119652:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598740992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.119682:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598740992:12345-0@lo:400:kworker.0 Request processed in 30us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044169.119688:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1784044169.119710:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044169.119714:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044169.119749:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598740608:0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.119770:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598740480:0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.119776:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1784044169.119781:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904ac1dbc380, transno 4294967310 00000100:00100000:3.0:1784044169.119791:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598740992:0@lo:400:kworker.0 00000100:00100000:1.0:1784044169.120752:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598740736:0@lo:400:kworker.0 00000100:00100000:1.0:1784044169.120794:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044169.120840:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784044169.120847:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598740352:0@lo:400:kworker.0 00000100:00100000:1.0:1784044169.120901:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044169.120924:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598740864:0@lo:400:kworker.0 00000100:00100000:1.0:1784044169.120947:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044169.120975:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598740352 00000100:00100000:1.0:1784044169.120980:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598740352 00000100:00100000:1.0:1784044169.121015:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1784044169.121022:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598740352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044169.121063:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598740352:12345-0@lo:400:kworker.0 Request processed in 41us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044169.121070:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1784044169.121109:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598740352:0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.121977:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598740736 00000100:00100000:3.0:1784044169.121985:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598740736 00000100:00100000:3.0:1784044169.122039:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784044169.122048:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598740736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.122104:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598740736:12345-0@lo:400:kworker.0 Request processed in 57us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044169.122111:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784044169.122142:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1784044169.122147:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff904bed937480, transno 4294967323 00000004:00080000:3.0:1784044169.122158:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1784044169.122177:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598740736:0@lo:400:kworker.0 00000100:00080000:1.0:1784044169.122623:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044169.123119:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598740864 00000100:00100000:3.0:1784044169.123127:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598740864 00000100:00100000:3.0:1784044169.123173:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784044169.123180:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598740864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044169.123234:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598740864:12345-0@lo:400:kworker.0 Request processed in 54us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044169.123241:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784044169.123279:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598740864:0@lo:400:kworker.0 00000100:00080000:1.0:1784044169.126315:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044169.133765:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044169.133795:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598741120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044169.133894:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044169.134442:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598741120 00000100:00100000:1.0:1784044169.134452:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598741120 00000100:00100000:1.0:1784044169.134503:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784044169.134513:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598741120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044169.134573:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784044169.134633:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598741120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044169.134640:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784044169.134913:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598741120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044169.632707:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598741248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044169.632823:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044169.632965:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598741248 00000100:00100000:2.0:1784044169.632976:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598741248 00000100:00100000:2.0:1784044169.633041:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784044169.633054:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598741248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044169.633108:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044169.633168:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598741248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044169.633177:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784044169.633253:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598741248:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784044170.079622:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044170.107494:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044170.107558:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044170.107594:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044170.107632:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044170.107675:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044170.107965:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583033088 00000100:00100000:0.0:1784044170.107977:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583033088 00000100:00100000:0.0:1784044170.108053:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583033472 00000100:00100000:0.0:1784044170.108057:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583033472 00000100:00100000:0.0:1784044170.108084:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 161 00000100:00100000:0.0:1784044170.108095:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:2347:x1870705583033088:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044170.108173:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:2347:x1870705583033088:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 79us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.108181:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 161 00000100:00100000:0.0:1784044170.108198:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:0.0:1784044170.108204:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705583033472:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044170.108231:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2347:x1870705583033472:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.108237:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:2.0:1784044170.108455:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583032960 00000100:00100000:2.0:1784044170.108460:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583032960 00000100:00100000:2.0:1784044170.108491:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 301 00000100:00100000:2.0:1784044170.108497:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2348:x1870705583032960:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044170.108543:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2348:x1870705583032960:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044170.108561:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 301 00000100:00080000:1.0:1784044170.108893:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044170.109098:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583033344 00000100:00100000:2.0:1784044170.109103:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583033344 00000100:00100000:2.0:1784044170.109196:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583033216 00000100:00100000:2.0:1784044170.109199:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583033216 00000100:00100000:0.0:1784044170.110128:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:0.0:1784044170.110143:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705583033344:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044170.110205:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2347:x1870705583033344:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 68us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.110213:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00080000:1.0:1784044170.114982:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784044170.114992:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044170.116687:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:2.0:1784044170.116715:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705583033216:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044170.116804:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2347:x1870705583033216:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 96us (9170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044170.116811:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:1.0:1784044170.371973:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044170.372085:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583033600 00000100:00100000:0.0:1784044170.372095:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583033600 00000100:00100000:0.0:1784044170.372161:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 238 00000100:00100000:0.0:1784044170.372171:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:11269:x1870705583033600:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784044170.372272:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:11269:x1870705583033600:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 Request processed in 103us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.372279:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 238 00000100:00100000:2.0:1784044170.381043:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044170.381421:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583033856 00000100:00100000:1.0:1784044170.381433:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583033856 00000100:00100000:1.0:1784044170.381496:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:1.0:1784044170.381507:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:11269:x1870705583033856:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784044170.382427:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:11269:x1870705583033856:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 917us (1391us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1784044170.382437:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:3.0:1784044170.589962:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044170.590133:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583033984 00000100:00100000:1.0:1784044170.590147:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583033984 00000100:00100000:1.0:1784044170.590223:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 239 00000100:00100000:1.0:1784044170.590235:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:12076:x1870705583033984:12345-192.168.204.50@tcp:101:lsof.0 00010000:00010000:1.0:1784044170.590263:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044170.590291:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a755101f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eada06 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044170.590390:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7551026 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044170.590409:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7551026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044170.590423:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7551026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044170.590694:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784044170.590699:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044170.590793:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7551026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044170.590828:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc600/0x9cc73983a755101f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada06 expref: 7 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044170.590851:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7551026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada06 expref: 6 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044170.590930:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:1.0:1784044170.590933:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044170.590938:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc000, rc 0) 00000100:00100000:1.0:1784044170.591037:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:12076:x1870705583033984:12345-192.168.204.50@tcp:101:lsof.0 Request processed in 803us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044170.591045:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 239 00000001:00080000:2.0:1784044170.706171:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1784044170.706197:0:5791:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1784044170.706266:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1784044170.706281:0:5802:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1784044171.102187:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044172.127567:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044172.638228:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044172.638241:0:11526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044172.638924:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1784044172.638937:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1784044173.150659:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784044174.007597:0:12713:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 11:49:32 (1784044172) 00010000:00010000:1.0:1784044174.177983:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044174.240264:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598741376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044174.240345:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044174.240532:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598741376 00000100:00100000:3.0:1784044174.240543:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598741376 00000100:00100000:3.0:1784044174.240609:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784044174.240619:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598741376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044174.240658:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044174.240702:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598741376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044174.240709:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1784044174.240768:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044174.240805:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598741376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044174.256783:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598741760:0@lo:400:kworker.0 00000100:00100000:3.0:1784044174.256794:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598741632:0@lo:400:kworker.0 00000100:00100000:0.0:1784044174.256810:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598741504:0@lo:400:kworker.0 00000100:00100000:3.0:1784044174.259338:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044174.259581:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044174.259615:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044174.259970:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598741632 00000100:00100000:0.0:1784044174.259972:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598741760 00000100:00100000:2.0:1784044174.259979:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598741632 00000100:00100000:0.0:1784044174.259979:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598741760 00000100:00100000:2.0:1784044174.260036:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784044174.260047:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598741632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044174.260215:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598741632:12345-0@lo:400:kworker.0 Request processed in 169us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044174.260223:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784044174.260420:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598741632:0@lo:400:kworker.0 00000100:00100000:0.0:1784044174.260591:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1784044174.260607:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beeef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598741760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044174.260610:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044174.260616:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044174.260632:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598741888:0@lo:400:kworker.0 00000100:00100000:2.0:1784044174.260636:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beeef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598742016:0@lo:400:kworker.0 00000100:00100000:0.0:1784044174.260661:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beeef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598741760:12345-0@lo:400:kworker.0 Request processed in 60us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044174.260669:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1784044174.260698:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598741504 00000100:00100000:0.0:1784044174.260703:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598741504 00000100:00100000:3.0:1784044174.260721:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044174.260723:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044174.260737:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1784044174.260751:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598741504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044174.260787:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598741760:0@lo:400:kworker.0 00000100:00100000:2.0:1784044174.260788:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598742016 00000100:00100000:2.0:1784044174.260802:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598742016 00000100:00100000:0.0:1784044174.260803:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598741504:12345-0@lo:400:kworker.0 Request processed in 56us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044174.260812:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784044174.260828:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598741888 00000100:00100000:3.0:1784044174.260836:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598741888 00000100:00100000:3.0:1784044174.260907:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784044174.260916:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598741888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044174.260970:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598741888:12345-0@lo:400:kworker.0 Request processed in 55us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044174.260991:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784044174.261020:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598741888:0@lo:400:kworker.0 00000100:00100000:2.0:1784044174.261311:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784044174.261322:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598742016:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784044174.261361:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044174.261366:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044174.261390:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598742016:12345-0@lo:400:kworker.0 Request processed in 69us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044174.261399:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784044174.261425:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598741504:0@lo:400:kworker.0 00000100:00100000:3.0:1784044174.261625:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beeef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598742016:0@lo:400:kworker.0 00000100:00100000:2.0:1784044174.750078:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044174.750102:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598742144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044174.750167:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044174.750226:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598742144 00000100:00100000:2.0:1784044174.750234:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598742144 00000100:00100000:2.0:1784044174.750278:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784044174.750287:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598742144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044174.750322:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044174.750367:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598742144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044174.750374:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784044174.750425:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598742144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784044175.198026:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044175.226123:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044175.226165:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044175.226199:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044175.226223:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044175.226247:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044175.226273:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583034624 00000100:00100000:1.0:1784044175.226294:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583034624 00000100:00100000:1.0:1784044175.226367:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583034240 00000100:00100000:1.0:1784044175.226370:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583034240 00000100:00100000:1.0:1784044175.226395:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 166 00000100:00100000:1.0:1784044175.226405:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:2345:x1870705583034624:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044175.226493:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:2345:x1870705583034624:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044175.226501:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 166 00000100:00100000:1.0:1784044175.226517:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:1.0:1784044175.226523:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:2345:x1870705583034240:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044175.226550:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:2345:x1870705583034240:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044175.226556:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:1.0:1784044175.226577:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583034368 00000100:00100000:1.0:1784044175.226580:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583034368 00000100:00100000:1.0:1784044175.226602:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583034496 00000100:00100000:1.0:1784044175.226605:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583034496 00000100:00100000:1.0:1784044175.226622:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:1.0:1784044175.226627:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc6b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2345:x1870705583034368:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044175.226651:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc6b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2345:x1870705583034368:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 23us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044175.226666:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:1.0:1784044175.226678:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:1.0:1784044175.226683:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705583034496:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044175.226707:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2345:x1870705583034496:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 24us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044175.226712:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00080000:1.0:1784044175.226727:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044175.226731:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784044175.226734:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044175.226930:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583034112 00000100:00100000:2.0:1784044175.226935:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583034112 00000100:00100000:2.0:1784044175.226968:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 303 00000100:00100000:2.0:1784044175.226974:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705583034112:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044175.227007:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2345:x1870705583034112:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 33us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044175.227013:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 303 00010000:00010000:1.0:1784044176.222529:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044177.212329:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044177.212499:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583034880 00000100:00100000:2.0:1784044177.212520:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583034880 00000100:00100000:2.0:1784044177.212595:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:2.0:1784044177.212606:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+18:12298:x1870705583034880:12345-192.168.204.50@tcp:35:umount.0 00000100:00080000:1.0:1784044177.213229:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044177.213413:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:12298:x1870705583034880:12345-192.168.204.50@tcp:35:umount.0 Request processed in 797us (1082us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1784044177.213423:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:2.0:1784044177.216672:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044177.216770:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583035136 00000100:00100000:3.0:1784044177.216782:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583035136 00000100:00100000:3.0:1784044177.216840:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:3.0:1784044177.216850:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+19:12298:x1870705583035136:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:3.0:1784044177.217233:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:12298:x1870705583035136:12345-192.168.204.50@tcp:35:umount.0 Request processed in 383us (571us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1784044177.217240:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:0.0:1784044177.219982:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044177.220080:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583035392 00000100:00100000:3.0:1784044177.220090:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583035392 00000100:00100000:3.0:1784044177.220153:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:3.0:1784044177.220164:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bcfecb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+20:12298:x1870705583035392:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:3.0:1784044177.220663:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bcfecb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:12298:x1870705583035392:12345-192.168.204.50@tcp:35:umount.0 Request processed in 499us (689us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1784044177.220671:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:1.0:1784044177.223375:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044177.223488:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583035648 00000100:00100000:3.0:1784044177.223499:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583035648 00000100:00100000:3.0:1784044177.223571:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:3.0:1784044177.223581:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+21:12298:x1870705583035648:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:3.0:1784044177.224269:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:12298:x1870705583035648:12345-192.168.204.50@tcp:35:umount.0 Request processed in 687us (900us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1784044177.224296:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:0.0:1784044177.229152:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044177.229252:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583035904 00000100:00100000:2.0:1784044177.229261:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583035904 00000100:00100000:2.0:1784044177.229340:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:2.0:1784044177.229352:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+5:2344:x1870705583035904:12345-192.168.204.50@tcp:9:umount.0 00000020:00000080:2.0:1784044177.229386:0:11907:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a7550376 00000100:00080000:2.0:1784044177.229394:0:11907:0:(import.c:65:import_set_state_nolock()) ffff904bc66fe000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044177.229452:0:11907:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:1.0:1784044177.229724:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044177.229965:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3609c122-577c-43fa-ab52-dd2c7dc5cce7+2:2344:x1870705583035904:12345-192.168.204.50@tcp:9:umount.0 Request processed in 616us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044177.229974:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00010000:00010000:0.0:1784044177.230419:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044177.232497:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044177.232533:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044177.232712:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583036032 00000100:00100000:1.0:1784044177.232720:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583036032 00000100:00100000:1.0:1784044177.232772:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583036160 00000100:00100000:1.0:1784044177.232775:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583036160 00000100:00100000:1.0:1784044177.232808:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1784044177.232816:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f40c65c2-a2d0-42d6-a031-2092177c578a+14:2347:x1870705583036032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044177.232831:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044177.232850:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1662000/0x9cc73983a7550004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead559 expref: 14 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044177.232891:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044177.232936:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f40c65c2-a2d0-42d6-a031-2092177c578a+13:2347:x1870705583036032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 120us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044177.232958:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1784044177.232999:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:1.0:1784044177.233006:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f40c65c2-a2d0-42d6-a031-2092177c578a+12:2347:x1870705583036160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044177.233013:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044177.233022:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904c02176000/0x9cc73983a75502b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead65c expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044177.233031:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044177.233046:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f40c65c2-a2d0-42d6-a031-2092177c578a+11:2347:x1870705583036160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 42us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044177.233053:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:1.0:1784044177.236108:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044177.237643:0:8289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583035776 00000100:00100000:0.0:1784044177.237659:0:8289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583035776 00000100:00100000:0.0:1784044177.237738:0:8289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1784044177.237749:0:8289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f40c65c2-a2d0-42d6-a031-2092177c578a+11:2346:x1870705583035776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044177.237764:0:8289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044177.237786:0:8289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1678200/0x9cc73983a755003c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead591 expref: 11 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.237823:0:8289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044177.238643:0:8289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2346:x1870705583035776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 892us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044177.238653:0:8289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00010000:00010000:3.0:1784044177.246117:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044177.249291:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044177.249572:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583036544 00000100:00100000:1.0:1784044177.249588:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583036544 00000100:00100000:1.0:1784044177.249750:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:1.0:1784044177.249763:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+7:2344:x1870705583036544:12345-192.168.204.50@tcp:9:umount.0 00000020:00000080:1.0:1784044177.249804:0:6571:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a75505de 00000020:00010000:1.0:1784044177.249814:0:6571:0:(genops.c:1942:obd_stale_export_put()) Put export ffff904bff69c000: total 0 00000100:00080000:1.0:1784044177.249820:0:6571:0:(import.c:65:import_set_state_nolock()) ffff904bc6bc8800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1784044177.249920:0:5758:0:(genops.c:1928:obd_stale_export_get()) Get export ffff904bff69c000: total 0 00000001:00000004:1.0:1784044177.249922:0:6571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:3.0:1784044177.250009:0:5758:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff904bff69c000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1784044177.250086:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b0b7c39/0x9cc73983a755097a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead831 expref: 6 pid: 6571 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.250137:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de555386/0x9cc73983a7551018 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ff expref: 5 pid: 11907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.250164:0:5758:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff904bff69c000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1784044177.250189:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044177.250192:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044177.250199:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044177.250350:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3609c122-577c-43fa-ab52-dd2c7dc5cce7+2:2344:x1870705583036544:12345-192.168.204.50@tcp:9:umount.0 Request processed in 586us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044177.250362:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00080000:0.0:1784044177.250918:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044177.266014:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044177.270171:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583037568 00000100:00100000:0.0:1784044177.270195:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583037568 00000100:00100000:0.0:1784044177.270370:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 240 00000100:00100000:0.0:1784044177.270386:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+22:2344:x1870705583037568:12345-192.168.204.50@tcp:39:umount.0 00000020:00000080:0.0:1784044177.270448:0:7482:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a7550012 00000020:00010000:0.0:1784044177.270483:0:7482:0:(genops.c:1942:obd_stale_export_put()) Put export ffff904bfb3ac000: total 0 00000100:00080000:0.0:1784044177.270489:0:7482:0:(import.c:65:import_set_state_nolock()) ffff904bfb3ad000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044177.270524:0:7482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1784044177.270593:0:5759:0:(genops.c:1928:obd_stale_export_get()) Get export ffff904bfb3ac000: total 0 00010000:00010000:3.0:1784044177.270604:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044177.270683:0:5759:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff904bfb3ac000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1784044177.270728:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044177.270733:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044177.270747:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b400/0x9cc73983a755093b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead81c expref: 21 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.270774:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:3.0:1784044177.270778:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044177.270783:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7550fd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9ea expref: 20 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.270826:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:3.0:1784044177.270829:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044177.270834:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0030a00/0x9cc73983a75509dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead84d expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.270861:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:3.0:1784044177.270932:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784044177.270940:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fdc00/0x9cc73983a7551003 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9f8 expref: 19 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.270968:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:3.0:1784044177.270971:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044177.270975:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc0031400/0x9cc73983a7550639 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead758 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.270991:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff904bd19d5e00) 00010000:00010000:3.0:1784044177.270994:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044177.271001:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4c00/0x9cc73983a75502dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead66a expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.271037:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044177.271040:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784044177.271044:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b000/0x9cc73983a7550965 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead82a expref: 17 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.271062:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044177.271065:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044177.271078:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b600/0x9cc73983a7550cd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead926 expref: 16 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.271105:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff904bc5fdb800) 00010000:00010000:3.0:1784044177.271108:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784044177.271115:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663200/0x9cc73983a755034c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead686 expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.271133:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff904bc5fdba00) 00010000:00010000:3.0:1784044177.271136:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044177.271140:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4e00/0x9cc73983a7550ef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead9b2 expref: 12 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.271158:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff904bc7c1e900) 00010000:00010000:3.0:1784044177.271161:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784044177.271166:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bffa9b200/0x9cc73983a75509f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead854 expref: 11 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.271182:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff904bc7c1eb00) 00010000:00010000:3.0:1784044177.271184:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044177.271188:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755085b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead7e4 expref: 10 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.271205:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59ad00) 00010000:00010000:3.0:1784044177.271208:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044177.271219:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6800/0x9cc73983a75502f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead671 expref: 9 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044177.271222:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3609c122-577c-43fa-ab52-dd2c7dc5cce7+9:2344:x1870705583037568:12345-192.168.204.50@tcp:39:umount.0 Request processed in 830us (5215us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1784044177.271248:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 240 00010000:00010000:3.0:1784044177.271255:0:5759:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff904bfb3ac000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1784044177.271286:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044177.271288:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044177.271290:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044178.270142:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044179.294308:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044179.305088:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044179.305146:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044179.305195:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044179.305719:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583037696 00000100:00100000:0.0:1784044179.305735:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583037696 00000100:00100000:2.0:1784044179.308020:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583037952 00000100:00100000:2.0:1784044179.308050:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583037952 00000100:00100000:2.0:1784044179.308141:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583037824 00000100:00100000:2.0:1784044179.308144:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583037824 00000100:00100000:2.0:1784044179.308176:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:2.0:1784044179.308187:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f40c65c2-a2d0-42d6-a031-2092177c578a+12:2347:x1870705583037696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044179.308207:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044179.308233:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beeee7400/0x9cc73983a75500e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5a6 expref: 12 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.308278:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044179.308380:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f40c65c2-a2d0-42d6-a031-2092177c578a+11:2347:x1870705583037696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 195us (3309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.308389:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:2.0:1784044179.308412:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:2.0:1784044179.308419:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f40c65c2-a2d0-42d6-a031-2092177c578a+10:2347:x1870705583037952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044179.308427:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044179.308436:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1678c00/0x9cc73983a75502ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead655 expref: 10 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.308447:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044179.308462:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f40c65c2-a2d0-42d6-a031-2092177c578a+9:2347:x1870705583037952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 44us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.308468:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:2.0:1784044179.308491:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:2.0:1784044179.308497:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f40c65c2-a2d0-42d6-a031-2092177c578a+8:2347:x1870705583037824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044179.308504:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044179.308512:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beeee6000/0x9cc73983a75500eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead5d0 expref: 8 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.308520:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044179.308535:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f40c65c2-a2d0-42d6-a031-2092177c578a+7:2347:x1870705583037824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 39us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.308541:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1784044179.316801:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044179.320186:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583038208 00000100:00100000:0.0:1784044179.320210:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583038208 00000100:00100000:0.0:1784044179.320832:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 241 00000100:00100000:0.0:1784044179.320848:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+6:2344:x1870705583038208:12345-192.168.204.50@tcp:39:umount.0 00000020:00000080:0.0:1784044179.320943:0:5770:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a75500f9 00000020:00010000:0.0:1784044179.320954:0:5770:0:(genops.c:1942:obd_stale_export_put()) Put export ffff904bfb416800: total 0 00000100:00080000:0.0:1784044179.320960:0:5770:0:(import.c:65:import_set_state_nolock()) ffff904bfb414800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044179.321008:0:5770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1784044179.321338:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c96f0df8-2a11-4448-8c45-0205cd1a93d6+5:2344:x1870705583038208:12345-192.168.204.50@tcp:39:umount.0 Request processed in 492us (4549us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1784044179.321347:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 241 00000020:00010000:3.0:1784044179.321558:0:5758:0:(genops.c:1928:obd_stale_export_get()) Get export ffff904bfb416800: total 0 00010000:00010000:3.0:1784044179.321643:0:5758:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff904bfb416800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784044179.321699:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc5fdbc00) 00010000:00010000:3.0:1784044179.321703:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044179.321714:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7551026 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada06 expref: 4 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.321743:0:5758:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff904bfb416800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1784044179.321757:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044179.321759:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044179.321761:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784044179.322394:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044179.351026:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044179.351334:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583038464 00000100:00100000:0.0:1784044179.351348:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583038464 00000100:00100000:0.0:1784044179.351429:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 304 00000100:00100000:0.0:1784044179.351441:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+7:2344:x1870705583038464:12345-192.168.204.50@tcp:251:umount.0 00000020:00000080:0.0:1784044179.351503:0:5762:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754ffef 00000020:00010000:0.0:1784044179.351513:0:5762:0:(genops.c:1942:obd_stale_export_put()) Put export ffff904bc66ff000: total 0 00000100:00080000:0.0:1784044179.351518:0:5762:0:(import.c:65:import_set_state_nolock()) ffff904bc66fd800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784044179.351964:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40c65c2-a2d0-42d6-a031-2092177c578a+3:2344:x1870705583038464:12345-192.168.204.50@tcp:251:umount.0 Request processed in 522us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044179.351974:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 304 00000020:00010000:1.0:1784044179.354144:0:5759:0:(genops.c:1928:obd_stale_export_get()) Get export ffff904bc66ff000: total 0 00010000:00010000:1.0:1784044179.354158:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044179.354226:0:5759:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff904bc66ff000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784044179.354743:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1679400/0x9cc73983a7550043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1ead598 expref: 2 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.354774:0:5759:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff904bc66ff000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1784044179.354792:0:5759:0:(genops.c:906:class_export_put()) final put ffff904bc66ff000/f40c65c2-a2d0-42d6-a031-2092177c578a 00010000:00010000:1.0:1784044179.354925:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044179.354928:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044179.354931:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784044179.358021:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc66ff000/f40c65c2-a2d0-42d6-a031-2092177c578a for MGS 00000020:00000080:3.0:1784044179.358094:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bc66fd800 for MGS 00000100:00100000:0.0:1784044179.358133:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598742272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044179.358239:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044179.358501:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598742528:0@lo:400:kworker.0 00000100:00100000:2.0:1784044179.358541:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044179.358566:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044179.358572:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598742656:0@lo:400:kworker.0 00000100:00100000:2.0:1784044179.358595:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044179.358633:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598742528 00000100:00100000:2.0:1784044179.358642:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598742528 00000100:00100000:2.0:1784044179.358693:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598742656 00000100:00100000:2.0:1784044179.358696:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598742656 00000100:00100000:2.0:1784044179.358734:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784044179.358744:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598742528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044179.358797:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784044179.358805:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598742528:12345-0@lo:400:kworker.0 Request processed in 63us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044179.358806:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598742656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044179.358814:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1784044179.358838:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044179.358841:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598742656:12345-0@lo:400:kworker.0 Request processed in 37us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044179.358848:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784044179.358894:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598742656:0@lo:400:kworker.0 00000100:00100000:3.0:1784044179.358899:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598742784:0@lo:400:kworker.0 00000100:00100000:2.0:1784044179.358906:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598742528:0@lo:400:kworker.0 00000100:00100000:3.0:1784044179.358936:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044179.358985:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784044179.358991:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598742400:0@lo:400:kworker.0 00000100:00100000:3.0:1784044179.359022:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044179.359044:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598742912:0@lo:400:kworker.0 00000100:00100000:2.0:1784044179.359060:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598742784 00000100:00100000:2.0:1784044179.359063:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598742784 00000100:00100000:3.0:1784044179.359070:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044179.359091:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784044179.359097:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598742784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044179.359098:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598742912 00000100:00100000:3.0:1784044179.359101:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598742912 00000100:00100000:2.0:1784044179.359132:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598742784:12345-0@lo:400:kworker.0 Request processed in 35us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044179.359135:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784044179.359139:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784044179.359141:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598742912:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784044179.359157:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044179.359160:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044179.359173:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598742912:12345-0@lo:400:kworker.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044179.359179:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784044179.359187:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598742912:0@lo:400:kworker.0 00000100:00100000:2.0:1784044179.359207:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598742784:0@lo:400:kworker.0 00000100:00100000:1.0:1784044179.359553:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598742272 00000100:00100000:1.0:1784044179.359559:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598742272 00000100:00100000:2.0:1784044179.359587:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598742400 00000100:00100000:2.0:1784044179.359592:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598742400 00000100:00100000:1.0:1784044179.359620:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784044179.359630:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1784044179.359644:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc4c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598742400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044179.359644:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598742272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044179.359689:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044179.359697:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc4c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598742400:12345-0@lo:400:kworker.0 Request processed in 58us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.359704:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1784044179.359745:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598742272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.359754:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598742400:0@lo:400:kworker.0 00000100:00100000:1.0:1784044179.359754:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784044179.359781:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598742272:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784044179.360259:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044179.873433:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598743040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044179.873548:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044179.874825:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598743040 00000100:00100000:3.0:1784044179.874842:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598743040 00000100:00100000:3.0:1784044179.874977:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784044179.874993:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598743040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044179.875040:0:6573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044179.875142:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598743040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044179.875150:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784044179.875244:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598743040:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1784044179.964297:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:0.0:1784044179.964308:0:7484:0:(genops.c:906:class_export_put()) final put ffff904bc66fc000/3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:2.0:1784044179.964410:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc66fc000/3609c122-577c-43fa-ab52-dd2c7dc5cce7 for lustre-OST0001 00000020:00000080:2.0:1784044179.964518:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bc66fe000 for lustre-OST0001 00010000:00010000:1.0:1784044180.331684:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784044180.963475:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c96f0df8-2a11-4448-8c45-0205cd1a93d6 00000001:00080000:0.0:1784044180.963492:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1784044180.963497:0:5791:0:(genops.c:906:class_export_put()) final put ffff904bfb416800/c96f0df8-2a11-4448-8c45-0205cd1a93d6 00000001:00100000:0.0:1784044180.963510:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000001:00080000:0.0:1784044180.963514:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1784044180.963531:0:5791:0:(genops.c:906:class_export_put()) final put ffff904bfb3ac000/3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:0.0:1784044180.963555:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bfb416800/c96f0df8-2a11-4448-8c45-0205cd1a93d6 for lustre-MDT0000 00000020:00000080:0.0:1784044180.963607:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bfb3ac000/3609c122-577c-43fa-ab52-dd2c7dc5cce7 for lustre-MDT0000 00000020:00000080:0.0:1784044180.963652:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bfb414800 for lustre-MDT0000 00000020:00000080:0.0:1784044180.963656:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bfb3ad000 for lustre-MDT0000 00000001:00100000:0.0:1784044180.976224:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:0.0:1784044180.976234:0:6598:0:(genops.c:906:class_export_put()) final put ffff904bff69c000/3609c122-577c-43fa-ab52-dd2c7dc5cce7 00000020:00000080:2.0:1784044180.976277:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff69c000/3609c122-577c-43fa-ab52-dd2c7dc5cce7 for lustre-OST0000 00000020:00000080:2.0:1784044180.976339:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bc6bc8800 for lustre-OST0000 00000020:01000004:1.0:1784044181.072379:0:12918:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784044181.080991:0:12918:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1784044181.081052:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.081069:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.081077:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.081095:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.081115:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784044181.081122:0:12918:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1784044181.081150:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044181.081157:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.081165:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662400 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784044181.081169:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.081177:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044181.081184:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044181.081190:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784044181.081193:0:5759:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784044181.081195:0:5759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784044181.081230:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.081237:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044181.081263:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.081270:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1662400/0x9cc73983a7550082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a7550089 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.081288:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044181.081289:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044181.081291:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044181.081309:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598743168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044181.081382:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044181.081447:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598743168 00000100:00100000:1.0:1784044181.081453:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598743168 00000100:00100000:1.0:1784044181.081497:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044181.081505:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3291:x1870705598743168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044181.081518:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044181.081532:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904c02177a00/0x9cc73983a7550089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a7550082 expref: 19 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.081545:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044181.081577:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+18:3291:x1870705598743168:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044181.081583:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044181.081616:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3291:1870705598743168:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1784044181.081640:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784044181.081644:0:12918:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784044181.081909:0:12918:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784044181.081923:0:12918:0:(import.c:65:import_set_state_nolock()) ffff904bed26d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784044181.085818:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870705598743296:0@lo:39:umount.0 00000100:00100000:0.0:1784044181.085923:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044181.087274:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598743296 00000100:00100000:2.0:1784044181.087285:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598743296 00000100:00100000:2.0:1784044181.087350:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784044181.087360:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac1dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870705598743296:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784044181.087390:0:5770:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fdfe 00000100:00080000:2.0:1784044181.087399:0:5770:0:(import.c:65:import_set_state_nolock()) ffff904bed242800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784044181.087488:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac1dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3287:x1870705598743296:12345-0@lo:39:umount.0 Request processed in 129us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044181.087495:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1784044181.087504:0:5770:0:(genops.c:906:class_export_put()) final put ffff904bcff20000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784044181.087618:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bcff20000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1784044181.087755:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784044181.088099:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bed242800 for lustre-MDT0000 00000100:00080000:0.0:1784044181.088216:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bed26d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784044181.088232:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870705598743296:0@lo:39:umount.0 00000100:00080000:1.0:1784044181.088270:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784044181.088285:0:12918:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784044181.088290:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784044181.090508:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090538:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090545:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090551:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090575:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044181.090581:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090588:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090594:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090600:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090615:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784044181.090621:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090643:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090649:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090655:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090663:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784044181.090668:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090675:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090681:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090687:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.090693:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1784044181.090696:0:12918:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1784044181.090722:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784044181.090730:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784044181.090738:0:12918:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:0.0:1784044181.090741:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1678600 already unused, calling callback (ffffffffc1b2fc20) 00000020:01000000:1.0:1784044181.090743:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:00010000:0.0:1784044181.090747:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784044181.090749:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044181.090755:0:12918:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00010000:00010000:0.0:1784044181.090759:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044181.090768:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044181.090774:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044181.090777:0:5759:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1784044181.090780:0:5759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1784044181.090831:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.090838:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044181.090888:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.090896:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1678600/0x9cc73983a7550090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a7550097 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.090909:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784044181.090912:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.090918:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1679800 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784044181.090920:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.090926:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044181.090932:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044181.090938:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044181.090940:0:5759:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1784044181.090942:0:5759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784044181.090965:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.090971:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044181.090977:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.090983:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1679800/0x9cc73983a754ffa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a754ffb0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091005:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044181.091008:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091013:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1679e00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784044181.091016:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091022:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044181.091029:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044181.091033:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784044181.091035:0:5759:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784044181.091036:0:5759:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784044181.091050:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091055:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044181.091076:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091082:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1679e00/0x9cc73983a755029d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a75502a4 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091091:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044181.091094:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091106:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5400 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784044181.091109:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091116:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044181.091122:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044181.091127:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044181.091129:0:5759:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1784044181.091131:0:5759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784044181.091147:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091153:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044181.091159:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091165:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f5400/0x9cc73983a754fd5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a754fd64 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.091177:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044181.091179:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044181.091181:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784044181.091189:0:12918:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff904bff99d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1784044181.091198:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac1dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598743424:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1784044181.091206:0:12918:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff904bd4379000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784044181.091212:0:12918:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff904bc4d0cd40) has exports, disconnecting them 00000020:00080000:1.0:1784044181.091216:0:12918:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff904bff99d000), last request at 1784044179 00000020:00000080:1.0:1784044181.091224:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754ff71 00000100:00080000:1.0:1784044181.091240:0:12918:0:(import.c:65:import_set_state_nolock()) ffff904bff99a000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784044181.091270:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598743680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044181.091285:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044181.091310:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044181.091347:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044181.091350:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044181.091357:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598743808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044181.091362:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598743552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044181.091384:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044181.091410:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598743424 00000100:00100000:0.0:1784044181.091417:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598743424 00000100:00100000:1.0:1784044181.091442:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598743680 00000100:00100000:1.0:1784044181.091447:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598743680 00000100:00100000:0.0:1784044181.091459:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598743808 00000100:00100000:0.0:1784044181.091463:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598743808 00000100:00100000:1.0:1784044181.091476:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1784044181.091540:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044181.091856:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc51f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+20:3288:x1870705598743424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044181.091906:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044181.091990:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1662c00/0x9cc73983a7550097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a7550090 expref: 20 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.092004:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044181.092038:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc51f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3288:x1870705598743424:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044181.093134:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044181.093194:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac1dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598743424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044181.093889:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044181.093897:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598743552 00000100:00100000:0.0:1784044181.093906:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598743552 00000100:00100000:0.0:1784044181.093947:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784044181.093959:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598743680:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044181.093967:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1784044181.093973:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784044181.093979:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+19:3290:x1870705598743808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044181.093989:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044181.093994:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beeee6c00/0x9cc73983a75502a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a755029d expref: 19 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044181.094003:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc0031a00/0x9cc73983a754fd64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a754fd5d expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.094010:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044181.094029:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044181.094079:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+17:3290:x1870705598743680:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (2769us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044181.094086:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784044181.094100:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784044181.094106:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+16:3288:x1870705598743552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044181.094113:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044181.094121:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f4400/0x9cc73983a754ffb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a754ffa9 expref: 16 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.094132:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044181.094162:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+15:3288:x1870705598743552:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044181.094169:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784044181.094200:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3288:1870705598743552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044181.094204:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712d3e65-f8dc-4c55-81e2-0af9d1e128ec+14:3290:x1870705598743808:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044181.094213:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1784044181.094250:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784044181.094373:0:12918:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff904bff99d000): rc 0 00000020:00000080:2.0:1784044181.094377:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bff99d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784044181.094427:0:12918:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff904bd4379000), last request at 1784044179 00000020:00000080:2.0:1784044181.094436:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fea6 00000100:00080000:2.0:1784044181.094445:0:12918:0:(import.c:65:import_set_state_nolock()) ffff904bd437c000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784044181.094470:0:12918:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff904bd4379000): rc 0 00000020:00000080:2.0:1784044181.094471:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bd4379000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:3.0:1784044181.094697:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598743808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044181.094707:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3290:1870705598743680:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1784044181.095128:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff99d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784044181.095285:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bff99a000 for lustre-MDT0000 00000004:00000080:2.0:1784044181.095382:0:12918:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9cac0197fae0 00000100:00080000:2.0:1784044181.095404:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784044181.095408:0:12918:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1784044181.095419:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784044181.095477:0:12918:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784044181.095665:0:12918:0:(import.c:65:import_set_state_nolock()) ffff904bf738f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784044181.095691:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784044181.095694:0:12918:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1784044181.095705:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784044181.095852:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598743936:0@lo:9:umount.0 00000100:00100000:3.0:1784044181.095931:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044181.095976:0:6569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598743936 00000100:00100000:3.0:1784044181.095983:0:6569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598743936 00000100:00100000:3.0:1784044181.096027:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784044181.096035:0:6569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870705598743936:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784044181.096056:0:6569:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fef3 00000100:00080000:3.0:1784044181.096062:0:6569:0:(import.c:65:import_set_state_nolock()) ffff904bc501a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784044181.096093:0:6569:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:0.0:1784044181.096394:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044181.096401:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044181.097013:0:6569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3287:x1870705598743936:12345-0@lo:9:umount.0 Request processed in 976us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044181.097023:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1784044181.097048:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044181.097374:0:12918:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784044181.097397:0:12918:0:(import.c:65:import_set_state_nolock()) ffff904bff66f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1784044181.097416:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bf738f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784044181.097427:0:3287:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784044181.097430:0:3287:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784044181.097435:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598743936:0@lo:9:umount.0 00000020:00080000:2.0:1784044181.097441:0:12918:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff904bc4d0cd40) has no exports 00000100:00100000:0.0:1784044181.097459:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598744064:0@lo:9:umount.0 00000100:00100000:0.0:1784044181.097504:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044181.097590:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598744064 00000100:00100000:2.0:1784044181.097597:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598744064 00000100:00100000:2.0:1784044181.097651:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784044181.097660:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1870705598744064:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784044181.097681:0:8310:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754ffda 00000100:00080000:2.0:1784044181.097689:0:8310:0:(import.c:65:import_set_state_nolock()) ffff904bfb3ae800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044181.097716:0:8310:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000020:00000080:1.0:1784044181.098070:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bd4379000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1784044181.098077:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3287:x1870705598744064:12345-0@lo:9:umount.0 Request processed in 416us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044181.098086:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000020:00000080:1.0:1784044181.098114:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bd437c000 for lustre-MDT0000 00010000:00010000:0.0:1784044181.098465:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044181.098473:0:5765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044181.104247:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bff66f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784044181.104272:0:3287:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784044181.104275:0:3287:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784044181.104282:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598744064:0@lo:9:umount.0 00000020:00080000:1.0:1784044181.113148:0:12918:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff904bc4d0cd40) has no exports 00000020:00000080:1.0:1784044181.154035:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fdb8 00000020:00000080:1.0:1784044181.154052:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bed26a000/lustre-QMT0000_UUID 00000020:01000000:1.0:1784044181.154080:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1784044181.154191:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044181.154202:0:12918:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784044181.154206:0:12918:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff904bc5a4b380) has no exports 00000020:00000080:3.0:1784044181.154575:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bed26a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784044181.154844:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fdb1 00000020:00000080:0.0:1784044181.154850:0:12918:0:(genops.c:906:class_export_put()) final put ffff904beede4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784044181.155046:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904beede4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784044181.155124:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044181.155132:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784044181.155135:0:12918:0:(genops.c:906:class_export_put()) final put ffff904beedde000/lustre-QMT0000_UUID 00000020:00000080:0.0:1784044181.155137:0:12918:0:(genops.c:865:class_export_destroy()) destroying export ffff904beedde000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784044181.155144:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1784044181.155264:0:12918:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff904bc504ba80 - data ffff904bc932f0d8/ffff904bfb4af400 00000020:01000000:0.0:1784044181.155420:0:12918:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff904bc5013240 - data ffff904be86d25e8/ffff904bed257400 00000001:00000004:0.0:1784044181.168152:0:12918:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1784044181.220241:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784044181.220249:0:12918:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1784044181.220277:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044181.220280:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784044181.221652:0:6888:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784044181.221659:0:6888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1784044181.221672:0:6888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1784044181.222823:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784044181.222828:0:12918:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1784044181.222852:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044181.222854:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784044181.223552:0:7964:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784044181.223557:0:7964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1784044181.223567:0:7964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1784044181.287809:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fd80 00000020:00000080:2.0:1784044181.287822:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bcff00800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044181.287858:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bcff00800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784044181.289421:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fd95 00000020:00000080:2.0:1784044181.289429:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bf5d17000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784044181.289437:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1784044181.289442:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044181.289450:0:12918:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784044181.289453:0:12918:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff904bc4d0b380) has no exports 00000004:01000000:2.0:1784044181.289651:0:12918:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784044181.289659:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754ffd3 00000020:00000080:2.0:1784044181.289663:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bfb416000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784044181.289667:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784044181.289670:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044181.289676:0:12918:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784044181.289678:0:12918:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff904bff854d40) has no exports 00000020:00000080:2.0:1784044181.289684:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754ffcc 00000020:00000080:2.0:1784044181.289688:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bff66c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044181.289715:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bf5d17000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1784044181.289731:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bfb416000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784044181.289735:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff66c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784044181.290129:0:12918:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784044181.290134:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784044181.290138:0:12918:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1784044181.290144:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044181.290150:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784044181.290213:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044181.290221:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784044181.290225:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754feec 00000020:00000080:2.0:1784044181.290236:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bff861800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784044181.290242:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784044181.290245:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044181.290248:0:12918:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784044181.290250:0:12918:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff904bed5c4d40) has no exports 00000020:00000080:2.0:1784044181.290254:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fee5 00000020:00000080:2.0:1784044181.290256:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bf738c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044181.290351:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bff66f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784044181.290357:0:8:0:(genops.c:906:class_export_put()) final put ffff904bc7c71000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784044181.290359:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc7c71000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784044181.290364:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784044181.290430:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff861800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784044181.290435:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bf738c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784044181.290712:0:12918:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784044181.290715:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784044181.290717:0:12918:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1784044181.290721:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044181.290722:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784044181.290840:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044181.290846:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784044181.291057:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bf738f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784044181.291063:0:8:0:(genops.c:906:class_export_put()) final put ffff904bff668800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784044181.291065:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff668800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784044181.291070:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784044181.291624:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044181.291630:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784044181.291633:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bc7c77800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784044181.291635:0:12918:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc7c77800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784044181.291639:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784044181.291757:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fd9c 00000020:00000080:2.0:1784044181.291766:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bf5d15800/lustre-MDD0000_UUID 00000020:01000000:2.0:1784044181.291773:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784044181.291776:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044181.291780:0:12918:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784044181.291782:0:12918:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff904bc4d099c0) has no exports 00000020:00000080:2.0:1784044181.291806:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044181.291809:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784044181.291812:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fda3 00000020:00000080:2.0:1784044181.291815:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bf5d13800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784044181.291822:0:12918:0:(tgt_mount.c:187:server_put_mount()) put mount ffff904bc9af1000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784044181.291825:0:12918:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904bc9af1000 3 00000020:01000004:2.0:1784044181.291827:0:12918:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff904bc9af1000 from lustre-MDT0000 00000020:00000080:2.0:1784044181.291850:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044181.291853:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784044181.291855:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bcff06000/lustre-MDT0000_UUID 00000020:00000080:2.0:1784044181.291857:0:12918:0:(genops.c:865:class_export_destroy()) destroying export ffff904bcff06000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784044181.291879:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784044181.291901:0:12918:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1784044181.291904:0:12918:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784044181.291907:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784044181.291909:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044181.291911:0:12918:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784044181.291917:0:12918:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff904bc4d2d000 712d3e65-f8dc-4c55-81e2-0af9d1e128ec 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784044181.291922:0:12918:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff904bc5a48000) has exports, disconnecting them 00000020:00080000:2.0:1784044181.291926:0:12918:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff904bc4d2d000), last request at 1784043960 00000020:00000080:2.0:1784044181.291938:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fd41 00000020:00010000:2.0:1784044181.291942:0:12918:0:(genops.c:1942:obd_stale_export_put()) Put export ffff904bc4d2d000: total 2 00000100:00080000:2.0:1784044181.291946:0:12918:0:(import.c:65:import_set_state_nolock()) ffff904bc4d28000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784044181.291960:0:12918:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff904bc4d2d000): rc 0 00000020:00080000:2.0:1784044181.291964:0:12918:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff904bc5a48000) has no exports 00000020:00010000:0.0:1784044181.291978:0:5759:0:(genops.c:1928:obd_stale_export_get()) Get export ffff904bc4d2d000: total 2 00000100:00100000:2.0:1784044181.292045:0:5764:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff904bf0554800:5764] 2 exiting: rc = 0 00010000:00010000:0.0:1784044181.292070:0:5759:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff904bc4d2d000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1784044181.292096:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bffa9b800/0x9cc73983a7550288 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a7550281 expref: 9 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.292110:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1679c00/0x9cc73983a755006d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a7550066 expref: 8 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044181.292121:0:5763:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff904bd03d6000:5763] 1 exiting: rc = 0 00010000:00010000:0.0:1784044181.292121:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904c02176200/0x9cc73983a755007b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a7550074 expref: 7 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.292131:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f5600/0x9cc73983a754fe59 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a754fe52 expref: 6 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.292157:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1679200/0x9cc73983a7550296 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a755028f expref: 5 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.292169:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1678e00/0x9cc73983a75500a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a755009e expref: 4 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.292179:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904c02177000/0x9cc73983a755005f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a7550058 expref: 3 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.292189:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1678400/0x9cc73983a7550051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9cc73983a755004a expref: 2 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.292199:0:5759:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff904bc4d2d000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1784044181.292212:0:5759:0:(genops.c:906:class_export_put()) final put ffff904bc4d2d000/712d3e65-f8dc-4c55-81e2-0af9d1e128ec 00010000:00010000:0.0:1784044181.292218:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044181.292220:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044181.292222:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044181.292242:0:5762:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff904bc5b01200:5762] 0 exiting: rc = 1 00000020:00000080:0.0:1784044181.292287:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bf5d15800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784044181.292292:0:8:0:(genops.c:906:class_export_put()) final put ffff904bf5d17800/lustre-MDD0000_UUID 00000020:00000080:0.0:1784044181.292293:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bf5d17800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784044181.292296:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:2.0:1784044181.292305:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292312:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292318:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292336:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292342:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292347:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292352:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292358:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292364:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292369:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292374:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292379:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292391:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292396:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292401:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292406:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292410:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292415:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292420:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292425:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292429:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292434:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292439:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292445:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784044181.292448:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bf5d13800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1784044181.292450:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784044181.292452:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc4d2d000/712d3e65-f8dc-4c55-81e2-0af9d1e128ec for MGS 00000100:00100000:2.0:1784044181.292456:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292460:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292466:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292471:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784044181.292476:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bc4d28000 for MGS 00000100:00100000:2.0:1784044181.292477:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292494:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292501:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292506:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292510:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292515:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292520:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292525:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292530:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292534:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292539:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292544:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292548:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292554:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292558:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292564:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292569:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292574:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292585:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292590:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292594:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292599:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292604:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292609:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292614:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292619:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292624:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292628:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292635:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292640:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292646:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292650:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292656:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292661:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.292673:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1784044181.293263:0:12918:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784044181.293267:0:12918:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1784044181.294176:0:12918:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff904bc7e86420 - data ffff904bfff9e000/ffff904bff627400 00000020:01000000:2.0:1784044181.294279:0:12918:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff904bc7f57300 - data ffff904bc9279af8/ffff904bc4c6dc00 00000020:00000080:0.0:1784044181.295087:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fd25 00000020:00000080:0.0:1784044181.295095:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bc728f000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784044181.295109:0:12918:0:(tgt_mount.c:187:server_put_mount()) put mount ffff904bc9af1000 from MGS, refs=2 00000020:01000004:0.0:1784044181.295112:0:12918:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904bc9af1000 2 00000020:01000004:0.0:1784044181.295124:0:12918:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff904bc9af1000 from MGS 00000020:00000080:0.0:1784044181.295144:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044181.295150:0:12918:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1784044181.295151:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc728f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784044181.295153:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bc7289000/MGS 00000020:00000080:0.0:1784044181.295155:0:12918:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc7289000/MGS for MGS 00000020:01000000:0.0:1784044181.295161:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1784044181.295209:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1784044181.295213:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044181.295218:0:12918:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784044181.295224:0:12918:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff904bed268800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784044181.295229:0:12918:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff904bed5c3380) has exports, disconnecting them 00000020:00080000:0.0:1784044181.295233:0:12918:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff904bed268800), last request at 1784043961 00000020:00000080:0.0:1784044181.295237:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fdf0 00000020:00080000:0.0:1784044181.295246:0:12918:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff904bed268800): rc 0 00000020:00000080:0.0:1784044181.295250:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bed268800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784044181.295281:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bed268800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784044181.295693:0:12918:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784044181.295697:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044181.295700:0:12918:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784044181.295703:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784044181.295784:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044181.295790:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784044181.295794:0:12918:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904bc9af1000 1 00000020:00000080:1.0:1784044181.295797:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bed26d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784044181.295798:0:12918:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fd17 00000020:00000080:0.0:1784044181.295801:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bc728e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784044181.295802:0:38:0:(genops.c:906:class_export_put()) final put ffff904bed26e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784044181.295804:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bed26e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784044181.295808:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1784044181.295819:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784044181.295822:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044181.295824:0:12918:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784044181.295827:0:12918:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff904bd40e3380) has no exports 00000020:00000080:1.0:1784044181.295847:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc728e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1784044181.347728:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784044181.406007:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044181.406022:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1784044181.406028:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bc7327800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784044181.406033:0:12918:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc7327800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784044181.406045:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1784044181.406169:0:12918:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff904bc7320000 00000020:01000000:3.0:1784044181.406187:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1784044181.406191:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044181.406195:0:12918:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784044181.406198:0:12918:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff904bc4d08000) has no exports 00000100:00100000:0.0:1784044181.406794:0:5771:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff904bc4d17200:5771] 2 exiting: rc = 0 00000100:00100000:3.0:1784044181.407012:0:5770:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff904bc7c59c00:5770] 1 exiting: rc = 0 00000100:00100000:0.0:1784044181.407098:0:7482:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff904bc5bbb200:7482] 3 exiting: rc = 0 00000100:00100000:1.0:1784044181.407507:0:5769:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff904bc4cb8200:5769] 0 exiting: rc = 1 00000100:00100000:3.0:1784044181.407738:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407746:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407753:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407759:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407765:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407770:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407774:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407780:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407784:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407789:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407794:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407799:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407806:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407812:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407817:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407822:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407831:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407838:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407842:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407847:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407852:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407858:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407928:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407935:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407941:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407953:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407959:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407965:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407971:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407987:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407993:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.407999:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408004:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408009:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408014:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408021:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408026:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408031:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408037:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408042:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408047:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408051:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408057:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408061:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408066:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408071:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408076:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408081:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408087:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408092:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408098:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408103:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408108:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408112:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408117:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408122:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408127:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408132:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408136:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408141:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408146:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408151:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408158:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.408163:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.413043:0:5772:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff904bd1bfb400:5772] 0 exiting: rc = 1 00000100:00100000:0.0:1784044181.414188:0:5773:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff904bc4d16200:5773] 1 exiting: rc = 0 00000100:00100000:3.0:1784044181.414343:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414352:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414358:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414363:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414370:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414376:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414382:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414389:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414395:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414401:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414408:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414414:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414422:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414427:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414432:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414437:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414443:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414447:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414452:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414458:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414464:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414470:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414475:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414481:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414486:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414492:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414498:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414503:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414509:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414514:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414519:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414524:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414529:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414534:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414539:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414571:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414576:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414581:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414587:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414593:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414598:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414603:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414608:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414613:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414617:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414622:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414626:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414631:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414636:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414641:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414646:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414651:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414657:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414662:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414666:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414672:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414677:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414683:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414688:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414705:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414711:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414717:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414722:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.414728:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044181.415373:0:5775:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff904bd1bc4a00:5775] 1 exiting: rc = 0 00000100:00100000:0.0:1784044181.415373:0:11851:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff904bc5613200:11851] 2 exiting: rc = 0 00000100:00100000:2.0:1784044181.415451:0:5774:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff904bd1bc5a00:5774] 0 exiting: rc = 1 00000100:00100000:3.0:1784044181.416459:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416467:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416473:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416478:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416483:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416490:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416511:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416516:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416521:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416527:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416546:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416566:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416572:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416578:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416584:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416590:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416595:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416601:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416608:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416614:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416619:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416625:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416643:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416650:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416655:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416661:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416667:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416673:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416678:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416684:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416695:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416700:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416706:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416712:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416730:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416738:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416743:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416748:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416753:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416759:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416764:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416777:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416784:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416789:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416795:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416801:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416821:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416829:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416834:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416840:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416846:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416858:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416879:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416895:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416901:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416906:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416911:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416917:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416937:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416944:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416950:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416955:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416961:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.416976:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.433386:0:6893:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0002: service thread [ffff904bff974000:6893] 2 exiting: rc = 0 00000100:00100000:3.0:1784044181.433480:0:5777:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff904bd1bfbc00:5777] 1 exiting: rc = 0 00000100:00100000:2.0:1784044181.434349:0:5776:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff904bd1bc5200:5776] 0 exiting: rc = 1 00000100:00100000:2.0:1784044181.434960:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.434968:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.434974:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.434979:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.434985:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.434991:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.434996:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435001:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435006:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435011:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435027:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435032:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435037:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435042:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435046:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435051:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435055:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435060:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435064:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435069:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435074:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435079:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435084:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435089:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435094:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435099:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435104:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435109:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435114:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435119:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435124:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435129:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435135:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435141:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435148:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435154:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435161:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435167:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435173:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435180:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435284:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435291:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435297:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435303:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435307:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435318:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435332:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435340:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435346:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435352:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435357:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435362:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435367:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435372:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435377:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435381:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435386:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435390:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435395:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435400:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435404:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435409:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435413:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.435418:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.437433:0:5778:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff904bd0287a00:5778] 0 exiting: rc = 1 00000100:00100000:0.0:1784044181.437956:0:5779:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff904bd145cc00:5779] 1 exiting: rc = 0 00000100:00100000:2.0:1784044181.438067:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438076:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438083:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438089:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438094:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438099:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438106:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438113:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438120:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438127:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438134:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438141:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438145:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438149:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438152:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438156:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438175:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438180:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438194:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438200:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438205:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438210:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438215:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438220:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438224:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438229:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438235:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438239:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438244:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438249:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438255:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438260:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438265:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438271:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438276:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438281:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438287:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438292:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438298:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438303:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438308:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438314:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438327:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438334:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438339:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438344:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438349:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438354:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438359:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438364:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438369:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438378:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438382:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438385:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438389:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438392:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438395:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438399:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438402:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438405:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438408:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438411:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438414:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.438417:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.438744:0:5780:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff904bd145d000:5780] 0 exiting: rc = 1 00000100:00100000:3.0:1784044181.439567:0:5781:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff904bd145d600:5781] 1 exiting: rc = 0 00000100:00100000:2.0:1784044181.439757:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439767:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439773:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439778:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439783:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439788:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439792:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439797:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439802:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439807:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439812:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439818:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439823:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439828:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439833:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439839:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439843:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439847:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439853:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.439858:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440109:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440119:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440137:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440145:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440151:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440157:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440162:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440167:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440173:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440178:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440183:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440189:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440193:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440199:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440204:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440209:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440214:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440220:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440225:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440229:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440234:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440240:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440246:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440251:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440256:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440262:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440268:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440273:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440279:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440284:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440290:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440295:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440300:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440304:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440309:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440315:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440332:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440345:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440351:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440356:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440361:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440366:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440371:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044181.440377:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044181.441750:0:5782:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff904bd145ca00:5782] 0 exiting: rc = 1 00000100:00100000:1.0:1784044181.441805:0:5783:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff904bd1457c00:5783] 1 exiting: rc = 0 00000100:00100000:1.0:1784044181.442043:0:5784:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff904bd145d400:5784] 2 exiting: rc = 0 00000100:00100000:0.0:1784044181.443092:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443106:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443113:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443124:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443130:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443136:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443142:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443150:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443170:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443181:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443200:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443205:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443211:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443217:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443223:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443228:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443234:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443241:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443247:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443253:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443259:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443265:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443272:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443278:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443299:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443307:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443313:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443337:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443344:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443368:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443374:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443380:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443386:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443392:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443398:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443404:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443410:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443416:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443422:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443428:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443434:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443440:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443446:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443452:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443458:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443464:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443470:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443476:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443497:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443504:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443510:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443516:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443523:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443529:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443535:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443542:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443549:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443556:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443562:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443570:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443576:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443583:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443589:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044181.443595:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784044181.448600:0:12918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044181.448615:0:12918:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1784044181.448621:0:12918:0:(genops.c:906:class_export_put()) final put ffff904bc7c74000/MDS_uuid 00000020:00000080:0.0:1784044181.448626:0:12918:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc7c74000/MDS_uuid for MDS 00000020:01000000:0.0:1784044181.448632:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1784044181.448787:0:12918:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1784044182.367269:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044183.393927:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784044183.995398:0:13067:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784044184.015183:0:13067:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1784044184.015233:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044184.015249:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044184.015255:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044184.015262:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044184.015295:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784044184.015301:0:13067:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784044184.015323:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044184.015327:0:13067:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784044184.015333:0:13067:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784044184.015366:0:13067:0:(import.c:65:import_set_state_nolock()) ffff904bff862800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784044184.015439:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1870705598744192:0@lo:39:umount.0 00000400:00000100:3.0:1784044184.015493:0:3287:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705598744192 offset 0 length 224: 4 00010000:00010000:1.0:1784044184.015907:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044184.015915:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044184.015938:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5c00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784044184.015942:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044184.015951:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044184.015958:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044184.015963:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784044184.015966:0:5759:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784044184.015968:0:5759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784044184.015993:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044184.015999:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044184.016020:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044184.016027:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f5c00/0x9cc73983a7550066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9cc73983a755006d expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044184.016038:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044184.016040:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044184.016041:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044184.016372:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044184.016395:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598744320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044184.016440:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044184.016631:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598744320 00000100:00100000:1.0:1784044184.016638:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598744320 00000100:00100000:1.0:1784044184.016676:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784044184.016682:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3289:x1870705598744320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1784044184.016689:0:5755:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784044184 with bad export cookie 11297061427893042497 00000100:00100000:0.0:1784044184.027794:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3289:x1870705598744320:12345-0@lo:103:ldlm_bl.0 Request processed in 11102us (11344us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784044184.027808:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1784044184.027917:0:3289:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784044184.027923:0:3289:0:(import.c:65:import_set_state_nolock()) ffff904beb234800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784044184.027927:0:3289:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784044184.040011:0:3289:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.150@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784044184.040018:0:3289:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784044184.040029:0:3289:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff904ac2b9df80 x1870705598744320/t0(0) o103->MGC192.168.204.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784044200 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784044184.040042:0:3289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784044184.040045:0:3289:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784044184.040046:0:3289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1784044184.040050:0:3289:0:(import.c:65:import_set_state_nolock()) ffff904beb234800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044184.040054:0:3289:0:(import.c:510:import_select_connection()) MGC192.168.204.150@tcp: connect to NID 0@lo last attempt 138 00000100:00080000:1.0:1784044184.040063:0:3289:0:(import.c:624:import_select_connection()) MGC192.168.204.150@tcp: import ffff904beb234800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1784044184.043482:0:3289:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bfb44ea00 x1870705598744448/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044184.043543:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3289:1870705598744320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044184.044739:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3287:1870705598744448:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1784044184.044795:0:3287:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705598744448 offset 0 length 520: 4 00010000:00010000:3.0:1784044184.414106:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044184.478087:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598744576:0@lo:400:kworker.0 00000400:00000100:3.0:1784044184.478140:0:3289:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705598744576 offset 0 length 224: 4 00000001:00100000:3.0:1784044185.060854:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784044185.060891:0:7484:0:(genops.c:906:class_export_put()) final put ffff904bfb3a8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784044185.061438:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff904bfb3a8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784044185.061488:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bfb3ae800 for lustre-OST0001 00010000:00010000:1.0:1784044185.438200:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784044186.108539:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784044186.108548:0:6598:0:(genops.c:906:class_export_put()) final put ffff904bc5019000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784044186.108653:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc5019000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1784044186.108758:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bc501a800 for lustre-OST0000 00010000:00010000:3.0:1784044186.463787:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044187.486202:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044188.510053:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044189.534684:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784044189.600101:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 712d3e65-f8dc-4c55-81e2-0af9d1e128ec->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784044189.600112:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 712d3e65-f8dc-4c55-81e2-0af9d1e128ec->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784044189.600228:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044189.601188:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598744704:0@lo:400:kworker.0 00000400:00000100:1.0:1784044189.601244:0:3291:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705598744704 offset 0 length 224: 4 00010000:00010000:3.0:1784044190.558795:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044191.582842:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044192.606190:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044193.630230:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044194.206008:0:3287:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044184/real 1784044184] req@ffff904bfb44ea00 x1870705598744448/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784044194 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044194.206053:0:3287:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff904bfb44ea00 x1870705598744448/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784044194 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044194.206064:0:3287:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044184/real 1784044184] req@ffff904bf5ba0380 x1870705598744192/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044194 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044194.206084:0:3287:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff904bf5ba0380 x1870705598744192/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044194 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044194.206102:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904beb234800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044194.206137:0:3287:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1784044194.206142:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3287:1870705598744448:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1784044194.206149:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bff862800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784044194.206166:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1870705598744192:0@lo:39:umount.0 00000100:00080000:1.0:1784044194.206429:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 712d3e65-f8dc-4c55-81e2-0af9d1e128ec->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044194.206434:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1784044194.206437:0:38:0:(import.c:65:import_set_state_nolock()) ffff904beb234800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044194.206449:0:38:0:(import.c:510:import_select_connection()) MGC192.168.204.150@tcp: connect to NID 0@lo last attempt 362 00000100:00080000:1.0:1784044194.206454:0:38:0:(import.c:589:import_select_connection()) MGC192.168.204.150@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784044194.206461:0:38:0:(import.c:624:import_select_connection()) MGC192.168.204.150@tcp: import ffff904beb234800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1784044194.206491:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904ac2b9fb80 x1870705598744832/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044194.206564:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044194.206577:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598744960:0@lo:400:kworker.0 00000400:00000100:1.0:1784044194.206624:0:3290:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705598744960 offset 0 length 224: 4 00000100:00100000:3.0:1784044194.206836:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3287:1870705598744832:0@lo:250:kworker.0 00000400:00000100:3.0:1784044194.206858:0:3287:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705598744832 offset 0 length 520: 4 00000100:00080000:0.0:1784044194.206958:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044194.206963:0:13067:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784044194.206975:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784044194.213010:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044194.213029:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044194.213036:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044194.213043:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044194.213073:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044194.213090:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044194.213096:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044194.213102:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044194.213108:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044194.213127:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1784044194.213132:0:13067:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1784044194.213153:0:13067:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1784044194.213158:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1784044194.213162:0:13067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044194.213182:0:13067:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784044194.213186:0:13067:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff904bd40e0000) has no exports 00000020:00080000:0.0:1784044194.213211:0:13067:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff904bd40e0000) has no exports 00010000:00010000:2.0:1784044194.213363:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044194.213380:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044194.213388:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663a00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044194.213392:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044194.213401:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044194.213408:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044194.213421:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784044194.213424:0:5759:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1784044194.213426:0:5759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1784044194.213442:0:5759:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff904beb234800 00010000:00010000:2.0:1784044194.213446:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044194.213453:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1663a00/0x9cc73983a7550074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a755007b expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044194.213468:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044194.213471:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044194.213477:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4600 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:2.0:1784044194.213479:0:5759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044194.213486:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044194.213492:0:5759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044194.213497:0:5759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784044194.213499:0:5759:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784044194.213501:0:5759:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784044194.213504:0:5759:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff904beb234800 00010000:00010000:2.0:1784044194.213507:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044194.213519:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f4600/0x9cc73983a755028f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a7550296 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044194.213527:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044194.213529:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044194.213531:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044194.215255:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1784044194.216509:0:13067:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff904bc7e86a20 - data ffff904bfff9ed80/ffff904bff624800 00000020:01000000:0.0:1784044194.216627:0:13067:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff904bed4feba0 - data ffff904ac1585288/ffff904bff501400 00100000:10000000:0.0:1784044194.230343:0:13067:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784044194.265418:0:13067:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fe75 00000020:00000080:2.0:1784044194.265428:0:13067:0:(genops.c:906:class_export_put()) final put ffff904bff668000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1784044194.265452:0:13067:0:(tgt_mount.c:187:server_put_mount()) put mount ffff904beee0a000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1784044194.265456:0:13067:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904beee0a000 2 00000020:01000004:2.0:1784044194.265459:0:13067:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff904beee0a000 from lustre-OST0000 00000020:00000080:2.0:1784044194.265483:0:13067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044194.265493:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1784044194.265496:0:13067:0:(genops.c:906:class_export_put()) final put ffff904bff698000/lustre-OST0000_UUID 00000020:00000080:2.0:1784044194.265500:0:13067:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff698000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1784044194.265506:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1784044194.265566:0:13067:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1784044194.265571:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784044194.265574:0:13067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044194.265579:0:13067:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784044194.265585:0:13067:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff904bff866800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784044194.265590:0:13067:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff904bff853380) has exports, disconnecting them 00000020:00080000:2.0:1784044194.265595:0:13067:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff904bff866800), last request at 1784043978 00000020:00000080:2.0:1784044194.265599:0:13067:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fe9f 00000020:00080000:2.0:1784044194.265610:0:13067:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff904bff866800): rc 0 00000020:00000080:2.0:1784044194.265615:0:13067:0:(genops.c:906:class_export_put()) final put ffff904bff866800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1784044194.266572:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff668000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784044194.266589:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff866800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1784044194.267127:0:13067:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1784044194.267132:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784044194.267136:0:13067:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784044194.267142:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784044194.267275:0:13067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044194.267282:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1784044194.267287:0:13067:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904beee0a000 1 00000020:00000080:3.0:1784044194.267292:0:13067:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fe2f 00000020:00000080:3.0:1784044194.267298:0:13067:0:(genops.c:906:class_export_put()) final put ffff904bf5d11000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1784044194.267302:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1784044194.267307:0:13067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044194.267310:0:13067:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784044194.267314:0:13067:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff904bd40e19c0) has no exports 00000020:00000080:1.0:1784044194.267621:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bff862800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1784044194.267627:0:38:0:(genops.c:906:class_export_put()) final put ffff904bff699000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1784044194.267630:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff699000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1784044194.267634:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1784044194.267682:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bf5d11000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784044194.307659:0:13067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044194.307682:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1784044194.307690:0:13067:0:(genops.c:906:class_export_put()) final put ffff904beee0b800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1784044194.307696:0:13067:0:(genops.c:865:class_export_destroy()) destroying export ffff904beee0b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1784044194.307716:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1784044194.309745:0:13067:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff904beee0a800 00000020:02000400:1.0:1784044194.309818:0:13067:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1784044194.654119:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044195.680685:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044196.702155:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784044196.758561:0:13221:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784044196.784448:0:13221:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1784044196.784524:0:13221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044196.784539:0:13221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044196.784547:0:13221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044196.784554:0:13221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044196.784578:0:13221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784044196.784584:0:13221:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784044196.784606:0:13221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044196.784618:0:13221:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff904bff59bb80 x1870705598744576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044200 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784044196.784691:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044196.784699:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044196.784726:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663400 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784044196.784730:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044196.784738:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044196.784744:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044196.784750:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784044196.784752:0:5758:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784044196.784755:0:5758:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784044196.784768:0:5758:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff904beb234800 00010000:00010000:1.0:1784044196.784771:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044196.784777:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1663400/0x9cc73983a755004a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a7550051 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044196.784789:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044196.784791:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044196.784793:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044196.784822:0:13221:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff904bff598000 x1870705598744704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044205 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044196.784845:0:13221:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff904ac2b9df80 x1870705598744960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044210 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044196.784859:0:13221:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784044196.784885:0:13221:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784044196.784915:0:13221:0:(import.c:65:import_set_state_nolock()) ffff904bfb3aa800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784044196.784993:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598744704:0@lo:400:kworker.0 00000100:00100000:3.0:1784044196.785064:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598744576:0@lo:400:kworker.0 00000100:00100000:3.0:1784044196.785090:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1870705598745088:0@lo:39:umount.0 00000400:00000100:3.0:1784044196.785137:0:3287:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705598745088 offset 0 length 224: 4 00000100:00100000:2.0:1784044196.785251:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598744960:0@lo:400:kworker.0 00010000:00010000:2.0:1784044197.726033:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044198.750154:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784044199.328068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 712d3e65-f8dc-4c55-81e2-0af9d1e128ec->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784044199.328080:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 712d3e65-f8dc-4c55-81e2-0af9d1e128ec->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1784044199.774348:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044200.802296:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044201.822099:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044202.846819:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044203.870224:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044204.446447:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 712d3e65-f8dc-4c55-81e2-0af9d1e128ec->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044204.446458:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 712d3e65-f8dc-4c55-81e2-0af9d1e128ec->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1784044204.894340:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044205.918759:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044206.942756:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044207.006248:0:3287:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044196/real 1784044196] req@ffff904bf5ba3800 x1870705598745088/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044206 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044207.006283:0:3287:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff904bf5ba3800 x1870705598745088/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044206 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044207.006303:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bfb3aa800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784044207.006338:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1870705598745088:0@lo:39:umount.0 00000100:00080000:0.0:1784044207.006541:0:13221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044207.006546:0:13221:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784044207.006550:0:13221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784044207.008645:0:13221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.008666:0:13221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.008673:0:13221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.008680:0:13221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.008705:0:13221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044207.008713:0:13221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.008720:0:13221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.008726:0:13221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.008732:0:13221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.008751:0:13221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1784044207.008769:0:13221:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1784044207.008789:0:13221:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1784044207.008793:0:13221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1784044207.008797:0:13221:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044207.008802:0:13221:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784044207.008807:0:13221:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff904bf5af8000) has no exports 00000020:00080000:0.0:1784044207.008831:0:13221:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff904bf5af8000) has no exports 00010000:00010000:1.0:1784044207.008887:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044207.008895:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044207.008905:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662600 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784044207.008910:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044207.008918:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044207.008926:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044207.008931:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784044207.008933:0:5758:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1784044207.008936:0:5758:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1784044207.008951:0:5758:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff904beb234800 00010000:00010000:1.0:1784044207.008955:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044207.008963:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7550058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a755005f expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044207.008976:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044207.008980:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044207.008986:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1679600 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784044207.008988:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044207.009003:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044207.009010:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044207.009015:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784044207.009017:0:5758:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784044207.009019:0:5758:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784044207.009037:0:5758:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff904beb234800 00010000:00010000:1.0:1784044207.009041:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044207.009048:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1679600/0x9cc73983a7550281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a7550288 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044207.009061:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044207.009063:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044207.009065:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044207.009162:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1784044207.012076:0:13221:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff904bc7e86900 - data ffff904be87d15e8/ffff904bff624400 00000020:01000000:0.0:1784044207.012198:0:13221:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff904bd02c0600 - data ffff904bfffad798/ffff904bfb3fc800 00100000:10000000:0.0:1784044207.021104:0:13221:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784044207.057398:0:13221:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754ff40 00000020:00000080:2.0:1784044207.057408:0:13221:0:(genops.c:906:class_export_put()) final put ffff904bc7f71800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1784044207.057431:0:13221:0:(tgt_mount.c:187:server_put_mount()) put mount ffff904bffcb1000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1784044207.057436:0:13221:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904bffcb1000 2 00000020:01000004:2.0:1784044207.057439:0:13221:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff904bffcb1000 from lustre-OST0001 00000020:00000080:2.0:1784044207.057466:0:13221:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044207.057475:0:13221:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1784044207.057478:0:13221:0:(genops.c:906:class_export_put()) final put ffff904bc7f74800/lustre-OST0001_UUID 00000020:00000080:2.0:1784044207.057481:0:13221:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc7f74800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1784044207.057487:0:13221:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1784044207.057585:0:13221:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 712d3e65-f8dc-4c55-81e2-0af9d1e128ec->MGS 00010000:00010000:2.0:1784044207.057600:0:13221:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc1662800/0x9cc73983a754fe52 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a754fe59 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044207.057612:0:13221:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc1662800/0x9cc73983a754fe52 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a754fe59 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044207.057619:0:13221:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1784044207.057622:0:13221:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1784044207.057635:0:13221:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1784044207.057649:0:13221:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff904beb234800 00010000:00010000:2.0:1784044207.057653:0:13221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc1662800/0x9cc73983a754fe52 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a754fe59 expref: -99 pid: 6567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044207.057679:0:13221:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904c02176a00/0x9cc73983a755009e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9cc73983a75500a5 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044207.057687:0:13221:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904c02176a00/0x9cc73983a755009e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9cc73983a75500a5 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044207.057692:0:13221:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784044207.057694:0:13221:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1784044207.057695:0:13221:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1784044207.057705:0:13221:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff904beb234800 00010000:00010000:2.0:1784044207.057708:0:13221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904c02176a00/0x9cc73983a755009e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9cc73983a75500a5 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784044207.057723:0:13221:0:(import.c:65:import_set_state_nolock()) ffff904beb234800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1784044207.057727:0:13221:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784044207.057729:0:13221:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784044207.057731:0:13221:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1784044207.057735:0:13221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784044207.057745:0:13221:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff904ac2b9fb80 x1870705598744832/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784044209 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784044207.057769:0:13221:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784044207.057781:0:13221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1784044207.057973:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:712d3e65-f8dc-4c55-81e2-0af9d1e128ec:3287:1870705598744832:0@lo:250:kworker.0 10000000:01000000:2.0:1784044207.058304:0:13221:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784044207.058313:0:13221:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754fd33 00000020:00000080:2.0:1784044207.058317:0:13221:0:(genops.c:906:class_export_put()) final put ffff904bc7c70800/712d3e65-f8dc-4c55-81e2-0af9d1e128ec 00000020:01000000:2.0:1784044207.058324:0:13221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.150@tcp (flags='') 00000020:00000080:2.0:1784044207.058329:0:13221:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044207.058334:0:13221:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784044207.058338:0:13221:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff904bd40e4d40) has no exports 00000020:00000080:3.0:1784044207.058413:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc7f71800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1784044207.058427:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc7c70800/712d3e65-f8dc-4c55-81e2-0af9d1e128ec for MGC192.168.204.150@tcp 10000000:01000000:0.0:1784044207.058791:0:5766:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1784044207.059018:0:13221:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.150@tcp: client import never connected 00000100:00080000:2.0:1784044207.059030:0:13221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1784044207.059033:0:13221:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784044207.059036:0:13221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1784044207.059037:0:13221:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784044207.059196:0:13221:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044207.059202:0:13221:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.150@tcp (uuid 712d3e65-f8dc-4c55-81e2-0af9d1e128ec) 00000020:01000000:2.0:1784044207.059209:0:13221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1784044207.059212:0:13221:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044207.059216:0:13221:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784044207.059222:0:13221:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff904bfb3af800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784044207.059227:0:13221:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff904bf5afb380) has exports, disconnecting them 00000020:00080000:2.0:1784044207.059231:0:13221:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff904bfb3af800), last request at 1784043995 00000020:00000080:2.0:1784044207.059236:0:13221:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754ff6a 00000020:00080000:2.0:1784044207.059248:0:13221:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff904bfb3af800): rc 0 00000020:00000080:2.0:1784044207.059252:0:13221:0:(genops.c:906:class_export_put()) final put ffff904bfb3af800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1784044207.059353:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904beb234800 for MGC192.168.204.150@tcp 00000020:00000080:3.0:1784044207.059360:0:38:0:(genops.c:906:class_export_put()) final put ffff904beb235000/712d3e65-f8dc-4c55-81e2-0af9d1e128ec 00000020:00000080:3.0:1784044207.059362:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904beb235000/712d3e65-f8dc-4c55-81e2-0af9d1e128ec for MGC192.168.204.150@tcp 00000020:01000000:3.0:1784044207.059367:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.150@tcp (712d3e65-f8dc-4c55-81e2-0af9d1e128ec) 00000020:00000080:3.0:1784044207.060740:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bfb3af800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1784044207.061920:0:13221:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1784044207.061938:0:13221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784044207.061942:0:13221:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784044207.061948:0:13221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784044207.062092:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff904bfb3aa800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1784044207.063129:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1784044207.063511:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1784044207.063748:0:5754:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff904bd0540600:5754] 1 exiting: rc = 0 00000100:00100000:3.0:1784044207.063934:0:5753:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff904bd0540c00:5753] 0 exiting: rc = 1 00000100:00100000:3.0:1784044207.066960:0:6585:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff904bff630400:6585] 2 exiting: rc = 0 00000100:00100000:0.0:1784044207.067531:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.067787:0:5756:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff904bc5c11000:5756] 1 exiting: rc = 0 00000100:00100000:3.0:1784044207.068018:0:5757:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff904bc5c11c00:5757] 2 exiting: rc = 0 00000100:00100000:0.0:1784044207.068173:0:5755:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff904bd0541200:5755] 0 exiting: rc = 1 00000100:00100000:1.0:1784044207.068632:0:8289:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff904bed920e00:8289] 3 exiting: rc = 0 00000100:00100000:0.0:1784044207.069020:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069028:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069034:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069040:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069046:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069052:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069058:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069063:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069071:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069076:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069082:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069087:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069093:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069129:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069136:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069142:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069150:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069155:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069160:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069166:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069170:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069175:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069181:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069186:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069191:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069196:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069200:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069205:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069211:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069215:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069220:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069226:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069231:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069236:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069241:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069246:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069251:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069255:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069260:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069265:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069395:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069401:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069406:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069411:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069416:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069422:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069427:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069432:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069446:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069450:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069455:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069461:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069465:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069470:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069475:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069481:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069486:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069491:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069496:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069502:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069507:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069512:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069517:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.069531:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784044207.072380:0:13221:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044207.072394:0:13221:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1784044207.072401:0:13221:0:(genops.c:906:class_export_put()) final put ffff904bc7f75800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1784044207.072418:0:13221:0:(genops.c:865:class_export_destroy()) destroying export ffff904bc7f75800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1784044207.072425:0:13221:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1784044207.072476:0:13221:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904bffcb1000 1 00000020:00000080:0.0:1784044207.072483:0:13221:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9cc73983a754ff0f 00000020:00000080:0.0:1784044207.072489:0:13221:0:(genops.c:906:class_export_put()) final put ffff904bff99f800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1784044207.072509:0:13221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1784044207.072570:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff904bff99f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1784044207.072674:0:13221:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044207.072681:0:13221:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784044207.072685:0:13221:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff904bed5c19c0) has no exports 00000020:00000080:0.0:1784044207.107670:0:13221:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044207.107687:0:13221:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1784044207.107693:0:13221:0:(genops.c:906:class_export_put()) final put ffff904bffcb4000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1784044207.107698:0:13221:0:(genops.c:865:class_export_destroy()) destroying export ffff904bffcb4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1784044207.107705:0:13221:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1784044207.107957:0:13221:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff904bffcb0800 00000020:01000000:0.0:1784044207.107981:0:13221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1784044207.107985:0:13221:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044207.107989:0:13221:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784044207.107993:0:13221:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff904bc5a4cd40) has no exports 00000020:00000080:0.0:1784044207.108014:0:13221:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044207.108020:0:13221:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1784044207.108023:0:13221:0:(genops.c:906:class_export_put()) final put ffff904bf5d16000/OSS_uuid 00000020:00000080:0.0:1784044207.108025:0:13221:0:(genops.c:865:class_export_destroy()) destroying export ffff904bf5d16000/OSS_uuid for OSS 00000020:01000000:0.0:1784044207.108029:0:13221:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1784044207.108051:0:5765:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1784044207.109536:0:8310:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff904beeee2c00:8310] 3 exiting: rc = 0 00000100:00100000:2.0:1784044207.109641:0:11907:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff904beeeef600:11907] 4 exiting: rc = 0 00000100:00100000:0.0:1784044207.110022:0:6571:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff904bc6743600:6571] 1 exiting: rc = 0 00000100:00100000:3.0:1784044207.110638:0:6569:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff904bd1251c00:6569] 0 exiting: rc = 1 00000100:00100000:3.0:1784044207.110692:0:6572:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff904bc6742600:6572] 2 exiting: rc = 0 00000100:00100000:0.0:1784044207.111007:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111017:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111022:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111172:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111178:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111182:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111187:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111192:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111196:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111200:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111205:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111209:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111214:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111218:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111223:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111227:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111232:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111237:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111242:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111246:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111250:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111255:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111260:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111277:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111283:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111288:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111293:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111297:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111302:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111307:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111312:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111317:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111322:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111326:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111331:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111336:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111340:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111345:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111349:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111366:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111373:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111379:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111385:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111391:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111398:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111405:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111412:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111421:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111427:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111439:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111445:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111449:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111454:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111459:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111465:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111470:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111475:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111482:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111496:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111503:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111512:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111518:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111529:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.111533:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.116673:0:6574:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff904bc6743800:6574] 1 exiting: rc = 0 00000100:00100000:0.0:1784044207.116971:0:6573:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff904bc6742c00:6573] 0 exiting: rc = 1 00000100:00100000:3.0:1784044207.117089:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117098:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117104:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117109:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117115:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117120:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117125:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117131:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117137:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117157:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117162:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117167:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117172:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117177:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117182:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117188:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117193:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117199:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117204:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117209:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117214:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117218:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117225:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117230:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117235:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117239:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117245:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117250:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117255:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117260:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117264:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117270:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117275:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117280:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117285:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117290:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117295:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117300:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117306:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117312:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117317:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117322:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117327:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117332:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117345:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117350:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117354:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117359:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117364:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117369:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117374:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117379:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117383:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117388:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117393:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117398:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117489:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117496:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117501:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117506:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117512:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117517:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117522:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044207.117527:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.119265:0:6577:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff904bc6743e00:6577] 2 exiting: rc = 0 00000100:00100000:3.0:1784044207.119540:0:11829:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff904bc5bba800:11829] 3 exiting: rc = 0 00000100:00100000:2.0:1784044207.121589:0:6576:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff904bd1250600:6576] 1 exiting: rc = 0 00000100:00100000:1.0:1784044207.122344:0:6575:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff904bd430a600:6575] 0 exiting: rc = 1 00000100:00100000:0.0:1784044207.123359:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123368:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123374:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123380:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123387:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123393:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123398:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123416:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123422:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123428:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123433:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123439:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123444:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123450:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123455:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123460:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123466:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123472:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123477:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123483:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123503:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123509:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123515:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123521:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123526:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123530:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123536:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123555:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123561:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123567:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123574:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123582:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123589:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123598:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123604:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123616:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123628:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123633:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123638:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123643:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123649:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123654:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123659:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123665:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123679:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123686:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123705:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123712:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123716:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123721:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123728:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123732:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123737:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123742:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123747:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123752:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123757:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123763:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123768:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123775:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123780:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123786:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123799:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044207.123811:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044207.135129:0:6578:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff904bd0591a00:6578] 0 exiting: rc = 1 00000100:00100000:1.0:1784044207.135224:0:6579:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff904bc5c3e200:6579] 1 exiting: rc = 0 00000100:00100000:2.0:1784044207.135300:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135308:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135314:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135319:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135324:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135329:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135334:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135339:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135344:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135349:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135355:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135360:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135365:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135370:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135389:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135394:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135399:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135404:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135409:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135414:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135419:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135424:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135429:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135434:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135439:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135445:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135450:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135455:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135459:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135464:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135469:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135474:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135479:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135484:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135489:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135494:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135499:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135504:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135509:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135513:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135518:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135524:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135529:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135534:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135540:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135545:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135550:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135554:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135559:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135572:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135577:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135582:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135587:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135592:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135597:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135602:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135607:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135612:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135618:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135623:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135628:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135633:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135637:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.135642:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044207.136658:0:6580:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff904bed285200:6580] 0 exiting: rc = 1 00000100:00100000:1.0:1784044207.136725:0:6581:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff904bf52cfc00:6581] 1 exiting: rc = 0 00000100:00100000:2.0:1784044207.137076:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137091:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137108:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137115:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137121:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137127:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137133:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137139:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137144:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137150:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137156:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137161:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137167:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137173:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137194:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137201:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137207:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137213:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137219:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137225:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137241:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137247:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137252:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137258:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137263:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137269:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137288:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137295:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137300:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137306:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137311:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137316:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137322:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137327:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137333:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137339:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137345:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137351:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137374:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137381:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137387:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137392:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137398:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137403:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137409:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137415:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137422:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137427:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137433:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137438:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137459:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137466:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137472:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137478:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137483:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137498:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137511:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137518:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137525:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137543:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137550:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137556:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137562:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044207.137567:0:13221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1784044207.145198:0:13221:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1784044223.340087:0:13842:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784044231.703693:0:14255:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784044231.703698:0:14255:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1784044231.703813:0:14255:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff904bc7f70800 00000020:01000004:2.0:1784044231.703828:0:14255:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784044231.703836:0:14255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784044231.703849:0:14255:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff904bf5af8000) 00000020:00000080:2.0:1784044231.703861:0:14255:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784044231.752149:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1784044231.762985:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1784044231.763337:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 497: rc = 0 00100000:10000000:0.0:1784044231.766891:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 497: rc = 0 00100000:10000000:0.0:1784044231.767106:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 497: rc = 0 00100000:10000000:0.0:1784044231.767202:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 497: rc = 0 00100000:10000000:0.0:1784044231.772722:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1784044231.772860:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 497: rc = 0 00100000:10000000:0.0:1784044231.773027:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 497: rc = 0 00100000:10000000:0.0:1784044231.775764:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 499: rc = 0 00100000:10000000:0.0:1784044231.783150:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 166: rc = 0 00100000:10000000:0.0:1784044231.783258:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 166: rc = 0 00100000:10000000:0.0:1784044231.785051:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 171: rc = 0 00100000:10000000:0.0:1784044231.785537:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 171: rc = 0 00100000:10000000:0.0:1784044231.785964:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 171: rc = 0 00100000:10000000:0.0:1784044231.786210:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 171: rc = 0 00100000:10000000:0.0:1784044231.790943:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 171: rc = 0 00100000:10000000:0.0:1784044231.791243:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 171: rc = 0 00100000:10000000:0.0:1784044231.793051:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 171: rc = 0 00100000:10000000:0.0:1784044231.793327:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 171: rc = 0 00100000:10000000:0.0:1784044231.796674:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 171: rc = 0 00100000:10000000:1.0:1784044231.800862:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 171: rc = 0 00100000:10000000:1.0:1784044231.801175:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 171: rc = 0 00100000:10000000:1.0:1784044231.806908:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 171: rc = 0 00100000:10000000:1.0:1784044231.807357:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 647: rc = 0 00100000:10000000:2.0:1784044231.808036:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 647: rc = 0 00100000:10000000:2.0:1784044231.808284:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 647: rc = 0 00100000:10000000:2.0:1784044231.808827:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 647: rc = 0 00100000:10000000:2.0:1784044231.809971:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 647: rc = 0 00100000:10000000:2.0:1784044231.810238:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 647: rc = 0 00100000:10000000:2.0:1784044231.815826:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 647: rc = 0 00100000:10000000:2.0:1784044231.819058:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 647: rc = 0 00100000:10000000:2.0:1784044231.824306:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 647: rc = 0 00100000:10000000:2.0:1784044231.825569:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 647: rc = 0 00100000:10000000:2.0:1784044231.827302:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 647: rc = 0 00100000:10000000:2.0:1784044231.830215:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 647: rc = 0 00100000:10000000:2.0:1784044231.834117:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 647: rc = 0 00100000:10000000:2.0:1784044231.838777:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 647: rc = 0 00100000:10000000:2.0:1784044231.839147:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 647: rc = 0 00100000:10000000:2.0:1784044231.843595:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 647: rc = 0 00100000:10000000:2.0:1784044231.843991:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 647: rc = 0 00100000:10000000:2.0:1784044231.844245:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 647: rc = 0 00100000:10000000:2.0:1784044231.844515:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 647: rc = 0 00100000:10000000:2.0:1784044231.844764:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 647: rc = 0 00100000:10000000:2.0:1784044231.845076:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 647: rc = 0 00100000:10000000:2.0:1784044231.845330:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 647: rc = 0 00100000:10000000:3.0:1784044231.846461:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 647: rc = 0 00100000:10000000:3.0:1784044231.846935:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 647: rc = 0 00100000:10000000:3.0:1784044231.847173:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 647: rc = 0 00100000:10000000:3.0:1784044231.852100:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 647: rc = 0 00100000:10000000:3.0:1784044231.856041:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 647: rc = 0 00100000:10000000:3.0:1784044231.859566:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 647: rc = 0 00100000:10000000:3.0:1784044231.860216:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 647: rc = 0 00100000:10000000:3.0:1784044231.863501:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 647: rc = 0 00100000:10000000:3.0:1784044231.865853:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 647: rc = 0 00100000:10000000:3.0:1784044231.867948:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 647: rc = 0 00100000:10000000:3.0:1784044231.868383:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 185: rc = 0 00100000:10000000:3.0:1784044231.879241:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1784044231.880047:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 167: rc = 0 00100000:10000000:2.0:1784044231.880786:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1784044231.881747:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 167: rc = 0 00100000:10000000:2.0:1784044231.882608:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1784044231.882772:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 167: rc = 0 00100000:10000000:2.0:1784044231.883157:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1784044231.883231:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 503: rc = 0 00100000:10000000:2.0:1784044231.883433:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1784044231.883501:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 503: rc = 0 00100000:10000000:2.0:1784044231.883714:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1784044231.883787:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 503: rc = 0 00000020:00000080:2.0:1784044231.884074:0:14255:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784044231.884082:0:14255:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784044231.884094:0:14255:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a7551034 00000020:01000004:2.0:1784044231.884103:0:14255:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1784044231.884108:0:14255:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784044231.884114:0:14255:0:(tgt_mount.c:101:server_register_mount()) register mount ffff904bc7f70800 from MGS 00000020:01000004:2.0:1784044231.884118:0:14255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784044231.884128:0:14255:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff904bf5afcd40) 00000020:00000080:2.0:1784044231.884139:0:14255:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1784044231.884194:0:14255:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904bc7f70800 from MGS, refs=2 00080000:01000000:2.0:1784044231.884205:0:14255:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784044231.884211:0:14255:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a7551042 00000100:00100000:2.0:1784044231.884307:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1784044231.884439:0:14255:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1784044231.884446:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1784044231.890736:0:14255:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1784044231.890752:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1784044231.893031:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044231.893209:0:14255:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1784044231.893215:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1784044231.896246:0:14255:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1784044231.896259:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1784044231.896743:0:14255:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1784044231.896750:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1784044231.897380:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044231.897383:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044231.897385:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044231.897780:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044231.897783:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044231.897784:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044231.898380:0:14255:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1784044231.918653:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1784044231.928741:0:14255:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1784044231.928763:0:14255:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784044231.928766:0:14255:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1784044231.931037:0:14264:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784044231.931196:0:14255:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784044231.931309:0:14255:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784044231.931993:0:14255:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784044231.932556:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784044231.933616:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784044231.933694:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784044231.934565:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784044231.934574:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784044231.935113:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784044231.935120:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1784044231.938518:0:14268:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1784044231.938739:0:14255:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784044231.938764:0:14255:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.150@tcp' 00000020:01000004:2.0:1784044231.938766:0:14255:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1784044231.938796:0:14255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.150@tcp (typ=mgc) 00000020:00000080:2.0:1784044231.938808:0:14255:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.150@tcp (ffff904bf5af99c0) 00000020:00000080:2.0:1784044231.938824:0:14255:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784044231.938930:0:14255:0:(ldlm_lib.c:102:import_set_conn()) imp ffff904bed26e800@MGC192.168.204.150@tcp: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1784044231.939089:0:14255:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.150@tcp-0 is initialized 00000040:01000000:2.0:1784044231.939097:0:14255:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 1 is initialized 10000000:01000000:0.0:1784044231.952156:0:14269:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1784044231.952264:0:14255:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.150@tcp (uuid d72db5ce-ca39-4323-bf26-8b60fe27b493) 00000020:00000080:2.0:1784044231.952301:0:14255:0:(genops.c:1406:class_connect()) connect: client d72db5ce-ca39-4323-bf26-8b60fe27b493, cookie 0x9cc73983a7551050 00000100:00080000:2.0:1784044231.952314:0:14255:0:(import.c:510:import_select_connection()) MGC192.168.204.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784044231.952320:0:14255:0:(import.c:624:import_select_connection()) MGC192.168.204.150@tcp: import ffff904bed26e800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1784044231.952354:0:14255:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bff599c00 x1870705598745216/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044231.952526:0:14255:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d72db5ce-ca39-4323-bf26-8b60fe27b493->MGS 00000020:01000004:2.0:1784044231.953566:0:14255:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784044231.953576:0:14255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784044231.953590:0:14255:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff904bf5afb380) 00000020:00000080:2.0:1784044231.953606:0:14255:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784044231.954843:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d72db5ce-ca39-4323-bf26-8b60fe27b493:3287:1870705598745216:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784044231.954930:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.964983:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598745216 00000100:00100000:3.0:1784044231.964997:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598745216 00000100:00100000:3.0:1784044231.965038:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044231.965047:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed95a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3287:x1870705598745216:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1784044231.965074:0:14265:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d72db5ce-ca39-4323-bf26-8b60fe27b493@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:3.0:1784044231.965107:0:14265:0:(genops.c:1406:class_connect()) connect: client d72db5ce-ca39-4323-bf26-8b60fe27b493, cookie 0x9cc73983a755105e 00000100:00080000:3.0:1784044231.965241:0:14265:0:(import.c:65:import_set_state_nolock()) ffff904bd43a7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044231.966255:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed95a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+5:3287:x1870705598745216:12345-0@lo:250:mount.lustre.0 Request processed in 1204us (11319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.966658:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784044231.968184:0:3287:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1784044231.968200:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.150@tcp: connect to target with instance 0 00000100:00080000:0.0:1784044231.968209:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784044231.968215:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784044231.968220:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bed26e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784044231.968223:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784044231.968235:0:3287:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784044231.968243:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d72db5ce-ca39-4323-bf26-8b60fe27b493:3287:1870705598745216:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784044231.969783:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044231.970049:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784044231.970058:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784044231.980197:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784044231.980210:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784044231.983084:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1784044231.983188:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784044231.984119:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784044231.984310:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784044231.984315:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1784044231.985092:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1784044231.985100:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1784044232.011965:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044232.012184:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784044232.012191:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784044232.013076:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784044232.013083:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784044232.013634:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044232.013764:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784044232.013769:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1784044232.014274:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784044232.014281:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1784044232.014852:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044232.015085:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784044232.015098:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1784044232.015541:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784044232.015548:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1784044232.016100:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044232.016481:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784044232.016487:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1784044232.017000:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784044232.017006:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784044232.029331:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044232.029583:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784044232.029591:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784044232.031315:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784044232.031326:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784044232.044483:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784044232.044506:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784044232.045612:0:14255:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784044232.045634:0:14255:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1784044232.045639:0:14255:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784044232.045773:0:14255:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784044232.045816:0:14255:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1784044232.045820:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784044232.045822:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784044232.045823:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044232.045824:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044232.045826:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044232.045827:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044232.045829:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044232.045830:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784044232.045832:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044232.045833:0:14255:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784044232.045836:0:14255:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784044232.045838:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784044232.045840:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784044232.045841:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044232.045842:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044232.045843:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044232.045848:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044232.045850:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044232.045850:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784044232.045851:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044232.045852:0:14255:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784044232.045914:0:14255:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784044232.045936:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745344:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784044232.046010:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044232.046062:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd892aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.046149:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598745344 00000100:00100000:0.0:1784044232.046156:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598745344 00000100:00100000:0.0:1784044232.046202:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044232.046212:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+5:14255:x1870705598745344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784044232.046268:0:14267:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784044232.046271:0:14267:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784044232.046274:0:14267:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1784044232.047094:0:14289:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784044232.047668:0:14267:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1784044232.051580:0:14290:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1784044232.051590:0:14290:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1784044232.051593:0:14290:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1784044232.051633:0:14290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1784044232.052512:0:14267:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784044232.052525:0:14267:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784044232.073943:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+5:14255:x1870705598745344:12345-0@lo:253:mount.lustre.0 Request processed in 27723us (27922us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.073985:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044232.074801:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745344:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784044232.074826:0:14255:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784044232.074830:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784044232.074832:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784044232.074833:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044232.074834:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044232.074836:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044232.074837:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044232.074839:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044232.074841:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784044232.074843:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044232.074845:0:14255:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784044232.074895:0:14255:0:(tgt_mount.c:101:server_register_mount()) register mount ffff904bc7f70800 from lustre-MDT0000 10000000:01000000:3.0:1784044232.074928:0:14255:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784044232.074931:0:14255:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784044232.074935:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff904bf5af99c0 10000000:01000000:3.0:1784044232.074939:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044232.074948:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff904bf5af99c0 from 1 10000000:01000000:3.0:1784044232.074950:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784044232.074999:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044232.075010:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044232.075035:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044232.075061:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044232.075110:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044232.075150:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7f2f300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.075704:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598745472 00000100:00100000:0.0:1784044232.075711:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598745472 00000100:00100000:0.0:1784044232.075774:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044232.075784:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+5:14255:x1870705598745472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044232.075812:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044232.075828:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee7400/0x9cc73983a755106c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7551065 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.075854:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee7400/0x9cc73983a755106c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7551065 expref: 6 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.075915:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee7400/0x9cc73983a755106c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7551065 expref: 6 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.075925:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7400, rc 0) 00000100:00100000:0.0:1784044232.075977:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+6:14255:x1870705598745472:12345-0@lo:101:mount.lustre.0 Request processed in 185us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.075983:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044232.076378:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044232.076396:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755106c expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.076406:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a755106c expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044232.076469:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044232.076499:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044232.076535:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc8120840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.076781:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598745600 00000100:00100000:0.0:1784044232.076787:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598745600 00000100:00100000:0.0:1784044232.076832:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044232.076839:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+6:14255:x1870705598745600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044232.077477:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+6:14255:x1870705598745600:12345-0@lo:501:mount.lustre.0 Request processed in 635us (974us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784044232.077486:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044232.077600:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745600:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784044232.077638:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784044232.077659:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755106c expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.077690:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755106c expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044232.077699:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff904bc7f70800 10000000:01000000:1.0:1784044232.077704:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784044232.077708:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff904bc7f70800 10000000:01000000:1.0:1784044232.077710:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784044232.077713:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff904bc7f70800 from 1 10000000:01000000:1.0:1784044232.077716:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784044232.077745:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beb0fcc00/0x9cc73983a7551073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.077753:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904beb0fcc00/0x9cc73983a7551073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.077763:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904beb0fcc00/0x9cc73983a7551073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044232.077780:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044232.077823:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044232.078265:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc8120840 going to sleep for 11 seconds 00000100:00100000:3.0:1784044232.082943:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598745728 00000100:00100000:3.0:1784044232.082960:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598745728 00000100:00100000:3.0:1784044232.083237:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044232.083249:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+6:14255:x1870705598745728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044232.083265:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044232.083288:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9a800/0x9cc73983a755107a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7551073 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044232.083316:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9a800/0x9cc73983a755107a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7551073 expref: 7 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044232.083326:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9a800/0x9cc73983a755107a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7551073 expref: 7 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044232.083335:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a800, rc 0) 00000100:00100000:3.0:1784044232.083432:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+7:14255:x1870705598745728:12345-0@lo:101:mount.lustre.0 Request processed in 186us (5608us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044232.083440:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784044232.083538:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044232.083557:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904beb0fcc00/0x9cc73983a7551073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755107a expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.083567:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904beb0fcc00/0x9cc73983a7551073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a755107a expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044232.083606:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784044232.083627:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beb0fcc00/0x9cc73983a7551073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755107a expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.083635:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904beb0fcc00/0x9cc73983a7551073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755107a expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044232.083645:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784044232.083651:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784044232.083656:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff904bc7f70800 10000000:01000000:1.0:1784044232.083658:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784044232.083662:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784044232.083665:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784044232.083701:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beb0fc400/0x9cc73983a7551081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.083709:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904beb0fc400/0x9cc73983a7551081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.083717:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904beb0fc400/0x9cc73983a7551081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044232.083739:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044232.083775:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044232.085176:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc8120840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.085288:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598745856 00000100:00100000:0.0:1784044232.085307:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598745856 00000100:00100000:0.0:1784044232.085344:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044232.085434:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+7:14255:x1870705598745856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044232.085449:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044232.085465:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee6800/0x9cc73983a7551088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7551081 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.085490:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee6800/0x9cc73983a7551088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7551081 expref: 8 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.085501:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee6800/0x9cc73983a7551088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7551081 expref: 8 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.085510:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6800, rc 0) 00000100:00100000:0.0:1784044232.085615:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+8:14255:x1870705598745856:12345-0@lo:101:mount.lustre.0 Request processed in 262us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.085622:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784044232.086158:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044232.086177:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904beb0fc400/0x9cc73983a7551081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551088 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.086196:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904beb0fc400/0x9cc73983a7551081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551088 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044232.086339:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044232.086448:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044232.086522:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc8120840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.086568:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598745984 00000100:00100000:0.0:1784044232.086573:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598745984 00000100:00100000:0.0:1784044232.086638:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044232.086646:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+8:14255:x1870705598745984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044232.087772:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+9:14255:x1870705598745984:12345-0@lo:501:mount.lustre.0 Request processed in 1122us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.087783:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044232.087919:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598745984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044232.087962:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598746112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044232.088017:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044232.088616:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc8120840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.088664:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598746112 00000100:00100000:0.0:1784044232.088682:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598746112 00000100:00100000:0.0:1784044232.088722:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044232.088731:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+9:14255:x1870705598746112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784044232.089511:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+9:14255:x1870705598746112:12345-0@lo:503:mount.lustre.0 Request processed in 777us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.089521:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044232.089730:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598746112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784044232.090758:0:14291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14291:1870705598746240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044232.094165:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044232.094234:0:14291:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb5d53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044232.094653:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598746240 00000100:00100000:2.0:1784044232.094663:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598746240 00000100:00100000:2.0:1784044232.094735:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784044232.094746:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+9:14291:x1870705598746240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044232.095109:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+9:14291:x1870705598746240:12345-0@lo:502:llog_process_th.0 Request processed in 363us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044232.095118:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784044232.095186:0:14291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14291:1870705598746240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044232.095223:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044232.095235:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.095238:0:14291:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784044232.095245:0:14291:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784044232.095249:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784044232.095265:0:14291:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff904bc4d08000) 00000020:00000080:2.0:1784044232.095288:0:14291:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784044232.095295:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784044232.095389:0:14291:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784044232.095397:0:14291:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a7551096 00000020:00000080:2.0:1784044232.095660:0:14291:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784044232.095666:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044232.095670:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.095672:0:14291:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784044232.095675:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044232.095687:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.095688:0:14291:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784044232.095692:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784044232.095700:0:14291:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff904bc4d099c0) 00000020:00000080:2.0:1784044232.095711:0:14291:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784044232.095716:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784044232.095719:0:14291:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784044232.095723:0:14291:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784044232.095730:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784044232.095772:0:14291:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904bc7f70800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784044232.095785:0:14291:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff904bc4d0cd40) 00000020:00000080:2.0:1784044232.095792:0:14291:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784044232.095845:0:14291:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784044232.095851:0:14291:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9cc73983a75510ab 00000020:00000080:2.0:1784044232.095974:0:14291:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784044232.095981:0:14291:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784044232.095986:0:14291:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9cc73983a75510b2 00080000:01000000:2.0:1784044232.095990:0:14291:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784044232.095993:0:14291:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a75510b9 00010000:00010000:0.0:1784044232.221105:0:14291:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1784044232.222100:0:14291:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1784044232.222907:0:14291:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784044232.223715:0:14291:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff904bc4d0b380) 00000020:00000080:2.0:1784044232.223736:0:14291:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784044232.223800:0:14291:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784044232.224137:0:14291:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a75510c7 00000020:00000080:3.0:1784044232.245066:0:14291:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784044232.261740:0:14291:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9cc73983a75510ce 00000020:00000080:2.0:1784044232.267123:0:14291:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784044232.267141:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044232.267150:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.267152:0:14291:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784044232.267155:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044232.267162:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.267163:0:14291:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784044232.267183:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784044232.267236:0:14291:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784044232.267252:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044232.267256:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.267257:0:14291:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784044232.267260:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784044232.267262:0:14291:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1784044232.267263:0:14291:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784044232.267278:0:14291:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784044232.267281:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784044232.267283:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.267285:0:14291:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784044232.267287:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784044232.267291:0:14291:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1784044232.267294:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.267295:0:14291:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784044232.267298:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784044232.267304:0:14291:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:2.0:1784044232.267331:0:14291:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784044232.267334:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784044232.267373:0:14291:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff904bf4ee8000) 00000020:00000080:2.0:1784044232.267392:0:14291:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1784044232.267399:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784044232.267481:0:14291:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784044232.267486:0:14291:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784044232.267493:0:14291:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a75510dc 00010000:00080000:2.0:1784044232.267524:0:14291:0:(ldlm_lib.c:102:import_set_conn()) imp ffff904bed26f000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1784044232.267739:0:14291:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1784044232.268229:0:14291:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784044232.268273:0:14291:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784044232.269150:0:14291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044232.269201:0:14291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1784044232.269311:0:14291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1784044232.273675:0:14295:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784044232.273683:0:14295:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784044232.274566:0:14291:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044232.274581:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784044232.274628:0:14291:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784044232.274649:0:14291:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9cc73983a75510e3 00000100:00080000:3.0:1784044232.274660:0:14291:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044232.274665:0:14291:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff904bed26f000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1784044232.274705:0:14291:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bfb44ea00 x1870705598746368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044232.274789:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598746368:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784044232.274894:0:3287:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705598746368 offset 0 length 520: 4 00000100:00080000:3.0:1784044232.279558:0:14291:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784044232.279679:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044232.279687:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044232.279690:0:14291:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784044232.279694:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784044232.279696:0:14291:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1784044232.279698:0:14291:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044232.279699:0:14291:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044232.279700:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784044232.279704:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044232.279706:0:14291:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784044232.279708:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784044232.279713:0:14291:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1784044232.279717:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044232.279718:0:14291:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784044232.279722:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784044232.279726:0:14291:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:3.0:1784044232.279753:0:14291:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784044232.279755:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044232.279771:0:14291:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff904bc5a4cd40) 00000020:00000080:3.0:1784044232.279791:0:14291:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1784044232.279796:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784044232.279911:0:14291:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784044232.279917:0:14291:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784044232.279924:0:14291:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9cc73983a75510f1 00010000:00080000:3.0:1784044232.279965:0:14291:0:(ldlm_lib.c:102:import_set_conn()) imp ffff904ac3627000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:3.0:1784044232.280203:0:14291:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1784044232.283001:0:14291:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784044232.283059:0:14291:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784044232.285822:0:14291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784044232.285955:0:14291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1784044232.286029:0:14291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1784044232.288196:0:14297:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784044232.288204:0:14297:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784044232.292304:0:14291:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044232.292321:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784044232.292369:0:14291:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784044232.292388:0:14291:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9cc73983a75510f8 00000100:00080000:3.0:1784044232.292400:0:14291:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044232.292406:0:14291:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff904ac3627000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1784044232.292455:0:14291:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bfb44dc00 x1870705598746496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044232.292474:0:14291:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784044232.292541:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044232.292546:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044232.292547:0:14291:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784044232.292550:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044232.292554:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044232.292555:0:14291:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784044232.292558:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784044232.292560:0:14291:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784044232.292562:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044232.292565:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044232.292566:0:14291:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784044232.292568:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044232.292571:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044232.292572:0:14291:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784044232.292576:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784044232.292611:0:14291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14291:1870705598746624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044232.292699:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044232.292743:0:14291:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7f2f300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044232.292893:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598746624 00000100:00100000:2.0:1784044232.292901:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598746624 00000100:00100000:2.0:1784044232.292951:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784044232.292961:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+9:14291:x1870705598746624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044232.293210:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+9:14291:x1870705598746624:12345-0@lo:502:llog_process_th.0 Request processed in 250us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044232.293218:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044232.293336:0:14291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14291:1870705598746624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044232.293375:0:14291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044232.293386:0:14291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044232.293388:0:14291:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784044232.293392:0:14291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1784044232.293790:0:14255:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1784044232.293813:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784044232.293837:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beb0fc400/0x9cc73983a7551081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551088 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.293849:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904beb0fc400/0x9cc73983a7551081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551088 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044232.293857:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff904bc7f70800 from 1 10000000:01000000:2.0:1784044232.293860:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784044232.293926:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.293934:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.293943:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044232.293960:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598746752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044232.293997:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044232.294027:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab7900 going to sleep for 11 seconds 00000100:00100000:1.0:1784044232.294097:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598746752 00000100:00100000:1.0:1784044232.294102:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598746752 00000100:00100000:1.0:1784044232.294137:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784044232.294144:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+9:14255:x1870705598746752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044232.294155:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044232.294167:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a75510ff expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.294198:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a75510ff expref: 10 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.294208:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75510ff expref: 10 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.294216:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc600, rc 0) 00000100:00100000:1.0:1784044232.294249:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+10:14255:x1870705598746752:12345-0@lo:101:mount.lustre.0 Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044232.294256:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044232.294395:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598746496:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784044232.294438:0:3287:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705598746496 offset 0 length 520: 4 00000100:00100000:2.0:1784044232.294748:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598746752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044232.294762:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.294771:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044232.296508:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598746880:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784044232.296582:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044232.296622:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5ab7900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044232.296657:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598746880 00000100:00100000:2.0:1784044232.296665:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598746880 00000100:00100000:2.0:1784044232.296726:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044232.296735:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+10:14255:x1870705598746880:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784044232.296759:0:14266:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784044232.296767:0:14266:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784044232.296844:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+10:14255:x1870705598746880:12345-0@lo:256:mount.lustre.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044232.296851:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044232.296918:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598746880:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784044232.298849:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784044232.298893:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.298906:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044232.298952:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bc7f70800 from 1 10000000:01000000:2.0:1784044232.298955:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044232.298990:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.298998:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.299008:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044232.299030:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044232.299087:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044232.299178:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd053e480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.303669:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598747008 00000100:00100000:0.0:1784044232.303691:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598747008 00000100:00100000:0.0:1784044232.303753:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784044232.303762:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+10:14255:x1870705598747008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044232.303778:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044232.303798:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee7600/0x9cc73983a7551114 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755110d expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.303827:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee7600/0x9cc73983a7551114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755110d expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.303838:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee7600/0x9cc73983a7551114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755110d expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.303894:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7600, rc 0) 00000100:00100000:0.0:1784044232.303982:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14255:x1870705598747008:12345-0@lo:101:mount.lustre.0 Request processed in 221us (4895us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.303990:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044232.304227:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044232.304248:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.304258:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044232.304346:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044232.304392:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044232.304580:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598747136 00000100:00100000:0.0:1784044232.304585:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598747136 00000100:00100000:0.0:1784044232.304622:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784044232.304629:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14255:x1870705598747136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044232.305053:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14255:x1870705598747136:12345-0@lo:501:mount.lustre.0 Request processed in 424us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.305062:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044232.305447:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd053e480 going to sleep for 11 seconds 00000100:00100000:2.0:1784044232.305468:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044232.305506:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044232.305554:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044232.305576:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd053e480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044232.305707:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598747264 00000100:00100000:1.0:1784044232.305712:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598747264 00000100:00100000:1.0:1784044232.305753:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044232.305761:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14255:x1870705598747264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044232.305974:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14255:x1870705598747264:12345-0@lo:503:mount.lustre.0 Request processed in 214us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044232.305982:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784044232.306535:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044232.315382:0:14299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14299:1870705598747392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044232.315489:0:14299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044232.315534:0:14299:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd053e480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044232.315659:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598747392 00000100:00100000:1.0:1784044232.315668:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598747392 00000100:00100000:1.0:1784044232.315719:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044232.315728:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14299:x1870705598747392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044232.316037:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14299:x1870705598747392:12345-0@lo:502:llog_process_th.0 Request processed in 309us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044232.316045:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784044232.316526:0:14299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14299:1870705598747392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044232.316556:0:14299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044232.316566:0:14299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.316569:0:14299:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784044232.316576:0:14299:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904bc7f70800 00000020:00000080:2.0:1784044232.316579:0:14299:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044232.316586:0:14299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044232.316589:0:14299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.316590:0:14299:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784044232.316592:0:14299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044232.316594:0:14299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.316596:0:14299:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784044232.316599:0:14299:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904bc7f70800 00000020:00000080:2.0:1784044232.316601:0:14299:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044232.316663:0:14299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044232.316667:0:14299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.316668:0:14299:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784044232.316671:0:14299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044232.316673:0:14299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.316674:0:14299:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784044232.316677:0:14299:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff904bc7f70800 00000020:00000080:2.0:1784044232.316679:0:14299:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784044232.316721:0:14299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14299:1870705598747520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044232.316771:0:14299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044232.316857:0:14299:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd053e480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.328307:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598747520 00000100:00100000:0.0:1784044232.328322:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598747520 00000100:00100000:0.0:1784044232.329954:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044232.329970:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14299:x1870705598747520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044232.331397:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14299:x1870705598747520:12345-0@lo:502:llog_process_th.0 Request processed in 1423us (14617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.331411:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784044232.335805:0:14299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14299:1870705598747520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044232.335855:0:14299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044232.335878:0:14299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044232.335881:0:14299:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784044232.335887:0:14299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1784044232.340418:0:14255:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1784044232.340459:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044232.340479:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044232.340493:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044232.340548:0:14255:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784044232.340551:0:14255:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff904bc7f70800 10000000:01000000:3.0:1784044232.340555:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff904bc7f70800 10000000:01000000:3.0:1784044232.340560:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044232.340565:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904bc7f70800 from 1 10000000:01000000:3.0:1784044232.340568:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784044232.340609:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9b800/0x9cc73983a755111b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044232.340617:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bffa9b800/0x9cc73983a755111b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044232.340629:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bffa9b800/0x9cc73983a755111b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044232.340654:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044232.340728:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044232.341749:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.344567:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598747648 00000100:00100000:0.0:1784044232.344581:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598747648 00000100:00100000:0.0:1784044232.344630:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784044232.344640:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14255:x1870705598747648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044232.344658:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044232.344677:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee6400/0x9cc73983a7551122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755111b expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.344717:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee6400/0x9cc73983a7551122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755111b expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.344729:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee6400/0x9cc73983a7551122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755111b expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.344738:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6400, rc 0) 00000100:00100000:0.0:1784044232.344806:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14255:x1870705598747648:12345-0@lo:101:mount.lustre.0 Request processed in 167us (4078us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.344813:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784044232.345197:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044232.345227:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bffa9b800/0x9cc73983a755111b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551122 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044232.345237:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bffa9b800/0x9cc73983a755111b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551122 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044232.345317:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044232.345363:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044232.345392:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc50336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.345550:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598747776 00000100:00100000:0.0:1784044232.345556:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598747776 00000100:00100000:0.0:1784044232.345592:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784044232.345600:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14255:x1870705598747776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044232.345965:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14255:x1870705598747776:12345-0@lo:501:mount.lustre.0 Request processed in 365us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.345973:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784044232.346004:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044232.346038:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784044232.346077:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044232.346092:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc6701840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.346107:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598747904 00000100:00100000:0.0:1784044232.346111:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598747904 00000100:00100000:0.0:1784044232.346130:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044232.346136:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14255:x1870705598747904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784044232.346294:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14255:x1870705598747904:12345-0@lo:503:mount.lustre.0 Request processed in 157us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.346301:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044232.346339:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598747904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044232.350699:0:14304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14304:1870705598748032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044232.350798:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044232.350846:0:14304:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7c55300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.351015:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598748032 00000100:00100000:0.0:1784044232.351022:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598748032 00000100:00100000:0.0:1784044232.351075:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784044232.351086:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14304:x1870705598748032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044232.351384:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14304:x1870705598748032:12345-0@lo:502:llog_process_th.0 Request processed in 299us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.351392:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044232.351628:0:14304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14304:1870705598748032:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1784044232.351694:0:14304:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784044232.351710:0:14304:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff904bed5c3380) 00000020:00000080:1.0:1784044232.351735:0:14304:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1784044232.351938:0:14304:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904bc7f70800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784044232.351943:0:14304:0:(tgt_mount.c:187:server_put_mount()) put mount ffff904bc7f70800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784044232.351945:0:14304:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904bc7f70800 4 00010000:00080000:1.0:1784044232.351974:0:14304:0:(ldlm_lib.c:102:import_set_conn()) imp ffff904beede0000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:1.0:1784044232.357214:0:14304:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1784044232.357363:0:14304:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784044232.357407:0:14304:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784044232.357422:0:14304:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9cc73983a7551130 00000100:00080000:1.0:1784044232.357433:0:14304:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784044232.357439:0:14304:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff904beede0000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1784044232.357478:0:14304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904ac2b9dc00 x1870705598748160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044232.357512:0:14304:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784044232.359569:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870705598748160:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044232.359652:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044232.360256:0:14304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14304:1870705598748288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044232.363701:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044232.363748:0:14304:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7c55300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044232.363992:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598748288 00000100:00100000:2.0:1784044232.364005:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598748288 00000100:00100000:2.0:1784044232.364056:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784044232.364065:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14304:x1870705598748288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044232.364647:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598748160 00000100:00100000:3.0:1784044232.364652:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598748160 00000100:00100000:3.0:1784044232.364686:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044232.364692:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3287:x1870705598748160:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784044232.364744:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3287:x1870705598748160:12345-0@lo:38:llog_process_th.0 Request processed in 50us (5091us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784044232.364751:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044232.364787:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784044232.364794:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904beede0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044232.364798:0:3287:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784044232.364802:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870705598748160:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044232.364855:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14304:x1870705598748288:12345-0@lo:502:llog_process_th.0 Request processed in 791us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044232.364886:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044232.375328:0:14304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d72db5ce-ca39-4323-bf26-8b60fe27b493:14304:1870705598748288:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784044232.375387:0:14304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784044232.377493:0:14255:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784044232.377529:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784044232.377546:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9b800/0x9cc73983a755111b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551122 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.377559:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bffa9b800/0x9cc73983a755111b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551122 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784044232.377622:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784044232.377625:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784044232.377627:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044232.377628:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044232.377629:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044232.377631:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044232.377632:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784044232.377634:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784044232.377636:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044232.377637:0:14255:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784044232.377643:0:14255:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784044232.377652:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784044232.377653:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784044232.377654:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044232.377655:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044232.377656:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044232.377657:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044232.377658:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784044232.377659:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784044232.377660:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044232.377660:0:14255:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784044232.377692:0:14255:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784044232.377715:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598748416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784044232.377806:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044232.377848:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc6701240 going to sleep for 11 seconds 00000100:00100000:1.0:1784044232.385479:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598748416 00000100:00100000:1.0:1784044232.385495:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598748416 00000100:00100000:1.0:1784044232.385579:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784044232.385588:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14255:x1870705598748416:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784044232.385628:0:14267:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784044232.385644:0:14267:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784044232.491198:0:14267:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784044232.491224:0:14267:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1784044232.491552:0:14289:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784044232.491558:0:14289:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784044232.491582:0:14289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.491604:0:14289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75510ff expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.491614:0:14289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.491669:0:14289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a75510ff expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.491684:0:14289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a75510ff expref: 12 pid: 14265 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044232.491700:0:14289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14289:1870705598748544:0@lo:104: 00000100:00100000:1.0:1784044232.491788:0:14289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044232.491853:0:14289:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7c55300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044232.491962:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598748544 00000100:00100000:0.0:1784044232.491970:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598748544 00000100:00100000:0.0:1784044232.492020:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784044232.492029:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+3:14289:x1870705598748544:12345-0@lo:104: 00010000:00010000:0.0:1784044232.492042:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492096:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784044232.492102:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+3:14289:x1870705598748544:12345-0@lo:104: Request processed in 75us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.492108:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1784044232.492131:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044232.492137:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492145:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4800 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784044232.492165:0:14262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492175:0:14262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044232.492183:0:14262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044232.492188:0:14262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784044232.492217:0:14262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492224:0:14262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044232.492243:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492249:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f4800/0x9cc73983a75510ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551106 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492282:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044232.492284:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044232.492285:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044232.492331:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d72db5ce-ca39-4323-bf26-8b60fe27b493:3288:1870705598748672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044232.492374:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044232.492522:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598748672 00000100:00100000:0.0:1784044232.492527:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598748672 00010000:00010000:0.0:1784044232.492544:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551106 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75510ff expref: 13 pid: 14265 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044232.492564:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784044232.492576:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+13:3288:x1870705598748672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044232.492587:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044232.492593:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551106 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75510ff expref: 13 pid: 14265 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492603:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a75510ff expref: 13 pid: 14265 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492618:0:14258:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492626:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784044232.492638:0:14258:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001082055s 00010000:00010000:0.0:1784044232.492643:0:14258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492649:0:14258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492656:0:14258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492662:0:14258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492667:0:14258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044232.492670:0:14258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492686:0:14258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492695:0:14258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.492704:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044232.492734:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+13:3288:x1870705598748672:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.492741:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784044232.492777:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d72db5ce-ca39-4323-bf26-8b60fe27b493:3288:1870705598748672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044232.493320:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a75510ff expref: 12 pid: 14265 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044232.493334:0:14289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14289:1870705598748544:0@lo:104: 00010000:00010000:1.0:1784044232.493360:0:14289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.493381:0:14289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.493388:0:14289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044232.493394:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beb0fc000/0x9cc73983a7551137 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044232.517199:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14255:x1870705598748416:12345-0@lo:253:mount.lustre.0 Request processed in 131600us (139382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044232.517215:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784044232.520482:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14255:1870705598748416:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784044232.520503:0:14255:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784044232.520507:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784044232.520509:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784044232.520510:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044232.520511:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044232.520513:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044232.520514:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044232.520516:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784044232.520517:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784044232.520519:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044232.520521:0:14255:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784044232.520539:0:14255:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784044232.547338:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784044232.547538:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784044232.547820:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784044232.548036:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784044232.548339:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784044232.548517:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1784044232.571081:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1784044232.571250:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1784044232.571539:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1784044232.571726:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1784044232.572020:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1784044232.572179:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1784044232.619856:0:14255:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1784044232.621785:0:14255:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1784044232.624010:0:14312:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1784044232.624120:0:14312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784044232.626313:0:14312:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784044232.626411:0:14312:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784044232.626416:0:14312:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1784044232.629498:0:14255:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784044232.629643:0:14255:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784044232.630108:0:14255:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784044232.630115:0:14255:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784044232.630229:0:14255:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1784044232.631937:0:14311:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1784044232.631946:0:14311:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1784044232.636700:0:14255:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784044232.637717:0:14255:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784044232.637766:0:14255:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1784044232.648597:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1784044232.663090:0:14255:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1784044232.727857:0:14255:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784044232.728098:0:14255:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9cac01ca3988 00100000:10000000:0.0:1784044232.728110:0:14255:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784044232.730055:0:14255:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784044232.730077:0:14255:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784044232.730095:0:14255:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1784044232.730126:0:14255:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1784044232.939109:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784044233.071935:0:14269:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784044233.071943:0:14269:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff904bc7f70800 from 6 10000000:01000000:0.0:1784044233.071949:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784044233.072008:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044233.072020:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044233.072033:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044233.072066:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598748800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044233.072163:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044233.072229:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7c55c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044233.072292:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598748800 00000100:00100000:2.0:1784044233.072311:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598748800 00000100:00100000:2.0:1784044233.072382:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044233.072409:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14269:x1870705598748800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044233.072427:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044233.072449:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f5200/0x9cc73983a7551145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755113e expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044233.072478:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f5200/0x9cc73983a7551145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755113e expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044233.072489:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f5200/0x9cc73983a7551145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755113e expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044233.072498:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5200, rc 0) 00000100:00100000:2.0:1784044233.072583:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14269:x1870705598748800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044233.072590:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044233.072651:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598748800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044233.072670:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044233.072681:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044233.072923:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598748928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784044233.072959:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044233.072981:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd892a180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044233.073004:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598748928 00000100:00100000:2.0:1784044233.073008:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598748928 00000100:00100000:2.0:1784044233.073033:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044233.073047:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14269:x1870705598748928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784044233.073063:0:14267:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784044233.073080:0:14267:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784044233.073083:0:14267:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1784044233.073179:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14269:x1870705598748928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044233.073185:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044233.073216:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598748928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784044233.073260:0:14269:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784044233.073266:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044233.073274:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044233.375786:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044233.958477:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044234.398688:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044234.991501:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044235.998300:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044237.022056:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784044237.726123:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044237.726131:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784044237.726134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044237.726137:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784044237.726140:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784044237.726143:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784044237.726147:0:37:0:(import.c:65:import_set_state_nolock()) ffff904beede0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044237.726167:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff904beede0000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1784044237.726191:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bff598a80 x1870705598749184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044237.726297:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598749056:0@lo:400:kworker.0 00000100:00100000:2.0:1784044237.726369:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044237.726478:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870705598749184:0@lo:38:kworker.0 00000100:00100000:2.0:1784044237.726506:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044237.726540:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598749056 00000100:00100000:2.0:1784044237.726548:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598749056 00000100:00100000:2.0:1784044237.726587:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784044237.726596:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:3289:x1870705598749056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044237.726644:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:3289:x1870705598749056:12345-0@lo:400:kworker.0 Request processed in 48us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044237.726650:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784044237.726696:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598749056:0@lo:400:kworker.0 00000100:00100000:0.0:1784044237.726930:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598749184 00000100:00100000:0.0:1784044237.726935:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598749184 00000100:00100000:0.0:1784044237.726964:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044237.726978:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3287:x1870705598749184:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784044237.727000:0:14275:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:0.0:1784044237.727031:0:14275:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9cc73983a755114c 00000004:00100000:0.0:1784044237.727046:0:14275:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784044237.727161:0:14275:0:(import.c:65:import_set_state_nolock()) ffff904bff69f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044237.727203:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870705598749184:12345-0@lo:38:kworker.0 Request processed in 224us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044237.727210:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784044237.727297:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff904bff598a80 x1870705598749184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784044237.727310:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1784044237.727317:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784044237.727321:0:3287:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784044237.727323:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904beede0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784044237.727329:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870705598749184:0@lo:38:kworker.0 00010000:00010000:2.0:1784044238.046857:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784044238.053072:0:14555:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784044239.070287:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044240.094381:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044241.118531:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784044241.356487:0:14705:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe78a32f30 20000000:00000080:2.0:1784044241.356509:0:14705:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff904bf4eca000 uarg=0000000000000000 20000000:01000000:2.0:1784044241.356543:0:14705:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1784044241.356550:0:14705:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1784044241.356555:0:14705:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1784044241.360209:0:14706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1784044241.360368:0:14705:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784044241.369474:0:14705:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784044241.369556:0:14705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044241.369578:0:14705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904beeee7600/0x9cc73983a7551114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755110d expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044241.369586:0:14705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044241.369632:0:14705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904beeee7600/0x9cc73983a7551114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a755110d expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044241.369648:0:14705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904beeee7600/0x9cc73983a7551114 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a755110d expref: 11 pid: 14266 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044241.369663:0:14705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14705:1870705598749312:0@lo:104: 00000100:00100000:2.0:1784044241.369729:0:14705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044241.369794:0:14705:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc24643c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044241.369808:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598749312 00000100:00100000:1.0:1784044241.369818:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598749312 00000100:00100000:1.0:1784044241.369903:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044241.369914:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+3:14705:x1870705598749312:12345-0@lo:104: 00010000:00010000:1.0:1784044241.369928:0:14257:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.369995:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044241.370001:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+3:14705:x1870705598749312:12345-0@lo:104: Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044241.370009:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1784044241.370032:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044241.370051:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044241.370060:0:14705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14705:1870705598749312:0@lo:104: 00010000:00010000:1.0:1784044241.370062:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784044241.370068:0:14262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370080:0:14262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044241.370087:0:14705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044241.370089:0:14262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044241.370105:0:14262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044241.370135:0:14262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370142:0:14262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044241.370172:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370189:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f4000/0x9cc73983a755110d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551114 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370205:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044241.370207:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044241.370208:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044241.370234:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044241.370244:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d72db5ce-ca39-4323-bf26-8b60fe27b493:3291:1870705598749440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044241.370272:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044241.370305:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598749440 00000100:00100000:1.0:1784044241.370315:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598749440 00010000:00010000:1.0:1784044241.370333:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904beeee7600/0x9cc73983a7551114 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a755110d expref: 12 pid: 14266 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044241.370355:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044241.370362:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:3291:x1870705598749440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044241.370373:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044241.370377:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904beeee7600/0x9cc73983a7551114 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a755110d expref: 12 pid: 14266 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370386:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904beeee7600/0x9cc73983a7551114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a755110d expref: 12 pid: 14266 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370399:0:14258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beeee7600/0x9cc73983a7551114 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a755110d expref: 12 pid: 14266 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370410:0:14258:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370418:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370430:0:14258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370437:0:14258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.370834:0:14258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.371062:0:14258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.371078:0:14258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044241.371083:0:14258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.371091:0:14258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.371111:0:14258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044241.371123:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044241.371136:0:14705:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044241.371157:0:14705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044241.371165:0:14705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f5000/0x9cc73983a7551153 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044241.371174:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:3291:x1870705598749440:12345-0@lo:103:ldlm_bl.0 Request processed in 811us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044241.371202:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044241.371416:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d72db5ce-ca39-4323-bf26-8b60fe27b493:3291:1870705598749440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044242.142201:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784044242.462014:0:14269:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044242.462023:0:14269:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bc7f70800 from 10 10000000:01000000:1.0:1784044242.462028:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044242.462080:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044242.462092:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044242.462102:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044242.462129:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598749568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044242.462209:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044242.462269:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bff67acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044242.465567:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598749568 00000100:00100000:0.0:1784044242.465582:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598749568 00000100:00100000:0.0:1784044242.465639:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044242.465651:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+11:14269:x1870705598749568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044242.465669:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044242.465692:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee6e00/0x9cc73983a7551161 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755115a expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044242.465722:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee6e00/0x9cc73983a7551161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755115a expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044242.465734:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee6e00/0x9cc73983a7551161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755115a expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044242.465744:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6e00, rc 0) 00000100:00100000:0.0:1784044242.465838:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14269:x1870705598749568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044242.465857:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784044242.467463:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598749568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044242.467489:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044242.467500:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044242.467575:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598749696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044242.467628:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044242.467678:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5033480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044242.467727:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598749696 00000100:00100000:0.0:1784044242.467733:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598749696 00000100:00100000:0.0:1784044242.467776:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784044242.467786:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14269:x1870705598749696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044242.468090:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14269:x1870705598749696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044242.468098:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044242.468699:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598749696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044242.468739:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598749824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044242.468786:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044242.468834:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5033480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044242.469578:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598749824 00000100:00100000:1.0:1784044242.469585:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598749824 00000100:00100000:1.0:1784044242.469704:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784044242.469713:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14269:x1870705598749824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044242.469927:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14269:x1870705598749824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044242.469934:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784044242.469947:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598749824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784044242.474460:0:14756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1784044242.476530:0:14269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1784044242.476578:0:14269:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784044242.476593:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044242.476610:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044242.847914:0:3287:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044232/real 1784044232] req@ffff904bfb44dc00 x1870705598746496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044242 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044242.847945:0:3287:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff904bfb44dc00 x1870705598746496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044242 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044242.847978:0:3287:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044232/real 1784044232] req@ffff904bfb44ea00 x1870705598746368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044242 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044242.847991:0:3287:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff904bfb44ea00 x1870705598746368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044242 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044242.848008:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904ac3627000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044242.848025:0:3287:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784044242.848029:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598746496:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1784044242.848035:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bed26f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044242.848039:0:3287:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784044242.848042:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598746368:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1784044242.848469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044242.848475:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784044242.848478:0:37:0:(import.c:65:import_set_state_nolock()) ffff904bed26f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044242.848483:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1784044242.848489:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784044242.848495:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff904bed26f000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1784044242.848526:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bf5ba3b80 x1870705598749952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044242.849803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044242.849807:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044242.849810:0:37:0:(import.c:65:import_set_state_nolock()) ffff904ac3627000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044242.849815:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1784044242.849819:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784044242.849825:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff904ac3627000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1784044242.849851:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bf5ba2d80 x1870705598750080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044242.850423:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044242.850439:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598750208:0@lo:400:kworker.0 00000100:00100000:3.0:1784044242.850767:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598749952:0@lo:8:kworker.0 00000400:00000100:3.0:1784044242.850799:0:3287:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705598749952 offset 0 length 520: 4 00000100:00100000:3.0:1784044242.850839:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598750080:0@lo:8:kworker.0 00000400:00000100:3.0:1784044242.850858:0:3287:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705598750080 offset 0 length 520: 4 00000100:00100000:0.0:1784044242.851037:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044242.855615:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598750208 00000100:00100000:3.0:1784044242.855631:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598750208 00000100:00100000:3.0:1784044242.855693:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044242.855704:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598750208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044242.855807:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598750208:12345-0@lo:400:kworker.0 Request processed in 103us (4768us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044242.855816:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784044242.855892:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff904bf5ba1f80 x1870705598750208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044242.855916:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598750208:0@lo:400:kworker.0 00010000:00010000:1.0:1784044243.166174:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044244.191592:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044244.643136:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784044245.215024:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784044245.259836:0:14907:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784044245.259840:0:14907:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1784044245.260316:0:14907:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff904bfb3aa800 00000020:01000004:2.0:1784044245.260334:0:14907:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1784044245.260348:0:14907:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784044245.260363:0:14907:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff904bf4eeb380) 00000020:00000080:2.0:1784044245.260379:0:14907:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784044245.287633:0:14907:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784044245.288697:0:14907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784044245.293329:0:14907:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784044245.294285:0:14907:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1784044245.294608:0:14907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784044245.295601:0:14907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 517: rc = 0 00100000:10000000:2.0:1784044245.295685:0:14907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 517: rc = 0 00100000:10000000:2.0:1784044245.295775:0:14907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 517: rc = 0 00100000:10000000:2.0:1784044245.296422:0:14907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 104: rc = 0 00100000:10000000:2.0:1784044245.297213:0:14907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 104: rc = 0 00100000:10000000:2.0:1784044245.297481:0:14907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 104: rc = 0 00100000:10000000:2.0:1784044245.298393:0:14907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 104: rc = 0 00100000:10000000:2.0:1784044245.298752:0:14907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 104: rc = 0 00100000:10000000:2.0:1784044245.299275:0:14907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 104: rc = 0 00000020:00000080:2.0:1784044245.301205:0:14907:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784044245.301221:0:14907:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784044245.301234:0:14907:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9cc73983a755116f 00000020:01000004:2.0:1784044245.301243:0:14907:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1784044245.301264:0:14907:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784044245.301267:0:14907:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784044245.301273:0:14907:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784044245.301276:0:14907:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784044245.301289:0:14907:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff904bf4eecd40) 00000020:00000080:2.0:1784044245.301298:0:14907:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1784044245.310249:0:14907:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044245.310474:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1784044245.310481:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1784044245.314055:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1784044245.314075:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784044245.315389:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784044245.315400:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1784044245.323764:0:14907:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044245.324204:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1784044245.324210:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1784044245.325079:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1784044245.325087:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784044245.345861:0:14907:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044245.347829:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784044245.347841:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784044245.349408:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784044245.349422:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1784044245.350755:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784044245.350765:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1784044245.353016:0:14907:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044245.353191:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1784044245.353197:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1784044245.356181:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1784044245.356194:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1784044245.412218:0:14907:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044245.412410:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1784044245.412417:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784044245.415451:0:14907:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784044245.415464:0:14907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1784044245.416130:0:14907:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1784044245.416152:0:14907:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1784044245.416158:0:14907:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784044245.428280:0:14907:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784044245.428320:0:14907:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1784044245.428325:0:14907:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784044245.428327:0:14907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784044245.428328:0:14907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044245.428329:0:14907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044245.428330:0:14907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044245.428332:0:14907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044245.428333:0:14907:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044245.428335:0:14907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044245.428337:0:14907:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784044245.428340:0:14907:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1784044245.428343:0:14907:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784044245.428344:0:14907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784044245.428345:0:14907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044245.428346:0:14907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044245.428347:0:14907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044245.428348:0:14907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044245.428349:0:14907:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044245.428350:0:14907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044245.428351:0:14907:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784044245.428379:0:14907:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784044245.428401:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784044245.428482:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044245.428538:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5571b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044245.428792:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598750336 00000100:00100000:0.0:1784044245.428801:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598750336 00000100:00100000:0.0:1784044245.428857:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784044245.428901:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14907:x1870705598750336:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784044245.428934:0:14267:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784044245.428937:0:14267:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1784044245.428942:0:14267:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784044245.450180:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14907:x1870705598750336:12345-0@lo:253:mount.lustre.0 Request processed in 21264us (21679us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.450196:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784044245.450384:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784044245.450401:0:14907:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784044245.450404:0:14907:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784044245.450406:0:14907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784044245.450407:0:14907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044245.450408:0:14907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044245.450410:0:14907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044245.450411:0:14907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044245.450412:0:14907:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044245.450414:0:14907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044245.450415:0:14907:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784044245.450435:0:14907:0:(tgt_mount.c:101:server_register_mount()) register mount ffff904bfb3aa800 from lustre-OST0000 10000000:01000000:2.0:1784044245.450460:0:14907:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1784044245.450463:0:14907:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1784044245.450470:0:14907:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff904bf5af99c0 local copy 00010000:00010000:2.0:1784044245.450480:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755106c expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044245.450723:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044245.450762:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044245.450804:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5cbf300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044245.450885:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598750464 00000100:00100000:3.0:1784044245.450891:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598750464 00000100:00100000:3.0:1784044245.450930:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784044245.450939:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14907:x1870705598750464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044245.451336:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14907:x1870705598750464:12345-0@lo:501:mount.lustre.0 Request processed in 396us (572us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044245.451345:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784044245.451409:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750464:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784044245.451423:0:14907:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784044245.451588:0:14907:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784044245.451595:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755106c expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.451617:0:14907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755106c expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044245.451639:0:14907:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff904bfb3aa800 10000000:01000000:1.0:1784044245.451644:0:14907:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784044245.451648:0:14907:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff904bf5af99c0 10000000:01000000:1.0:1784044245.451650:0:14907:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1784044245.451654:0:14907:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff904bf5af99c0 from 1 10000000:01000000:1.0:1784044245.451657:0:14907:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784044245.451683:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beb0fdc00/0x9cc73983a755117d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.451692:0:14907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904beb0fdc00/0x9cc73983a755117d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.451701:0:14907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904beb0fdc00/0x9cc73983a755117d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044245.451716:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044245.451746:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044245.451829:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904be032d900 going to sleep for 11 seconds 00000100:00100000:0.0:1784044245.451947:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598750592 00000100:00100000:0.0:1784044245.451953:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598750592 00000100:00100000:0.0:1784044245.451982:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784044245.451989:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+12:14907:x1870705598750592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044245.452007:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044245.452021:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee7a00/0x9cc73983a7551184 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755117d expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.452042:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee7a00/0x9cc73983a7551184 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755117d expref: 13 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.452053:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee7a00/0x9cc73983a7551184 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755117d expref: 13 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.452062:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7a00, rc 0) 00000100:00100000:0.0:1784044245.452336:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+13:14907:x1870705598750592:12345-0@lo:101:mount.lustre.0 Request processed in 347us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.452343:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784044245.452438:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044245.452452:0:14907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904beb0fdc00/0x9cc73983a755117d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551184 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.452472:0:14907:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904beb0fdc00/0x9cc73983a755117d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551184 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044245.452490:0:14907:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784044245.452541:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beb0fdc00/0x9cc73983a755117d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551184 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.452548:0:14907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904beb0fdc00/0x9cc73983a755117d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551184 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044245.452556:0:14907:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784044245.452560:0:14907:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044245.452565:0:14907:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784044245.452567:0:14907:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784044245.452582:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9b000/0x9cc73983a755118b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.452590:0:14907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bffa9b000/0x9cc73983a755118b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.452597:0:14907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bffa9b000/0x9cc73983a755118b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044245.452610:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044245.452638:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.452667:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebea80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044245.452723:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598750720 00000100:00100000:1.0:1784044245.452727:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598750720 00000100:00100000:1.0:1784044245.452761:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784044245.452769:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+13:14907:x1870705598750720:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044245.452777:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044245.452786:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755118b expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.452811:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755118b expref: 14 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.452819:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beb0fc600/0x9cc73983a7551192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755118b expref: 14 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.452826:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc600, rc 0) 00000100:00100000:1.0:1784044245.452884:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+14:14907:x1870705598750720:12345-0@lo:101:mount.lustre.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044245.452891:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044245.452965:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044245.452976:0:14907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bffa9b000/0x9cc73983a755118b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551192 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.452990:0:14907:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bffa9b000/0x9cc73983a755118b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551192 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044245.453733:0:14907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784044245.455061:0:14907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044245.455419:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784044245.455466:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784044245.455515:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784044245.455565:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784044245.455601:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784044245.455634:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784044245.455709:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784044245.455717:0:14907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784044245.455796:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044245.455856:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.455938:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044245.456147:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598750848 00000100:00100000:0.0:1784044245.456155:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598750848 00000100:00100000:0.0:1784044245.456321:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784044245.456331:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+14:14907:x1870705598750848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044245.456679:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+14:14907:x1870705598750848:12345-0@lo:501:mount.lustre.0 Request processed in 348us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.456688:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044245.456791:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044245.456829:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044245.456889:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044245.456911:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf5cbf300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044245.456961:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598750976 00000100:00100000:0.0:1784044245.456966:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598750976 00000100:00100000:0.0:1784044245.456994:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784044245.457001:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+14:14907:x1870705598750976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784044245.457478:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+14:14907:x1870705598750976:12345-0@lo:503:mount.lustre.0 Request processed in 476us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.457496:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044245.457837:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598750976:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784044245.458536:0:14907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044245.458607:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044245.458663:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.458751:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe780 going to sleep for 11 seconds 00000100:00100000:0.0:1784044245.459028:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598751104 00000100:00100000:0.0:1784044245.459035:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598751104 00000100:00100000:0.0:1784044245.459127:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784044245.459137:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+14:14907:x1870705598751104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044245.459356:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+14:14907:x1870705598751104:12345-0@lo:502:mount.lustre.0 Request processed in 220us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.459363:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784044245.459435:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044245.459673:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784044245.459719:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784044245.459749:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784044245.459790:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784044245.459823:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784044245.459853:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784044245.459933:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784044245.459977:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784044245.460017:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1784044245.460060:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1784044245.460096:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1784044245.460156:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1784044245.460189:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044245.460231:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.460638:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044245.460670:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598751232 00000100:00100000:2.0:1784044245.460682:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598751232 00000100:00100000:0.0:1784044245.460727:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784044245.460736:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+14:14907:x1870705598751232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044245.460928:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+14:14907:x1870705598751232:12345-0@lo:502:mount.lustre.0 Request processed in 192us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.460936:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784044245.461020:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044245.461085:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1784044245.461095:0:14907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1784044245.462311:0:14921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784044245.462321:0:14921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1784044245.462327:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.462330:0:14921:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784044245.462334:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044245.462351:0:14921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff904bc5a499c0) 00000020:00000080:3.0:1784044245.462372:0:14921:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784044245.462377:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784044245.462440:0:14921:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904bfb3aa800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784044245.462447:0:14921:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784044245.462454:0:14921:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9cc73983a75511a0 00010000:00010000:3.0:1784044245.466793:0:14921:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1784044245.467396:0:14921:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1784044245.469178:0:14921:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1784044245.474612:0:14921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1784044245.474625:0:14921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044245.474632:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.474634:0:14921:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1784044245.474638:0:14921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784044245.474641:0:14921:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1784044245.474653:0:14921:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044245.474655:0:14921:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044245.474656:0:14921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784044245.474659:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.474661:0:14921:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784044245.474664:0:14921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044245.474667:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.474668:0:14921:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784044245.474671:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784044245.474673:0:14921:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784044245.474675:0:14921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044245.474677:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.474679:0:14921:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784044245.474681:0:14921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044245.474683:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.474684:0:14921:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784044245.474687:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784044245.474750:0:14921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044245.474753:0:14921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.474755:0:14921:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784044245.474757:0:14921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1784044245.474945:0:14907:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1784044245.474974:0:14907:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784044245.474989:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9b000/0x9cc73983a755118b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551192 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044245.475001:0:14907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bffa9b000/0x9cc73983a755118b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551192 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044245.475009:0:14907:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bfb3aa800 from 1 10000000:01000000:2.0:1784044245.475011:0:14907:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044245.475047:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044245.475054:0:14907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044245.475064:0:14907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044245.475090:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044245.475985:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044245.476031:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5571900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044245.476092:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598751360 00000100:00100000:3.0:1784044245.476110:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598751360 00000100:00100000:3.0:1784044245.476269:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784044245.476280:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+14:14907:x1870705598751360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044245.476295:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044245.476307:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9b600/0x9cc73983a75511ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a75511a7 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.476330:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9b600/0x9cc73983a75511ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a75511a7 expref: 15 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.476340:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9b600/0x9cc73983a75511ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75511a7 expref: 15 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.476356:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b600, rc 0) 00000100:00100000:3.0:1784044245.476397:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598751360:12345-0@lo:101:mount.lustre.0 Request processed in 118us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044245.476403:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044245.476487:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044245.476501:0:14907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044245.476511:0:14907:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044245.477046:0:14907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1784044245.477823:0:14907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044245.478153:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1784044245.479829:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784044245.480354:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784044245.480365:0:14907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1784044245.480471:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044245.480536:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.480621:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe180 going to sleep for 11 seconds 00000100:00100000:1.0:1784044245.480666:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598751488 00000100:00100000:1.0:1784044245.480673:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598751488 00000100:00100000:1.0:1784044245.480750:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044245.480760:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598751488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044245.481118:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598751488:12345-0@lo:501:mount.lustre.0 Request processed in 359us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044245.481134:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784044245.481558:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044245.481598:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044245.481637:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044245.481702:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5571900 going to sleep for 11 seconds 00000100:00100000:1.0:1784044245.481736:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598751616 00000100:00100000:1.0:1784044245.481742:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598751616 00000100:00100000:1.0:1784044245.481775:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784044245.481781:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598751616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044245.482137:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598751616:12345-0@lo:503:mount.lustre.0 Request processed in 355us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044245.482145:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784044245.482373:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751616:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784044245.483344:0:14907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044245.483421:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044245.483482:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.483565:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044245.483603:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598751744 00000100:00100000:2.0:1784044245.483609:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598751744 00000100:00100000:2.0:1784044245.483652:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784044245.483661:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598751744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044245.483958:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598751744:12345-0@lo:502:mount.lustre.0 Request processed in 298us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044245.483965:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044245.484256:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044245.484478:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1784044245.484524:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1784044245.484564:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1784044245.484593:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1784044245.484619:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1784044245.484655:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1784044245.484699:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1784044245.484725:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1784044245.484752:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044245.484788:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.484854:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe780 going to sleep for 11 seconds 00000100:00100000:0.0:1784044245.485063:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598751872 00000100:00100000:0.0:1784044245.485069:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598751872 00000100:00100000:0.0:1784044245.485157:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784044245.485279:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598751872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044245.485443:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598751872:12345-0@lo:502:mount.lustre.0 Request processed in 167us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.485451:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784044245.485514:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598751872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044245.485594:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784044245.485603:0:14907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1784044245.486531:0:14925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044245.486539:0:14925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.486542:0:14925:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784044245.486547:0:14925:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904bfb3aa800 00000020:00000080:3.0:1784044245.486549:0:14925:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044245.486555:0:14925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044245.486557:0:14925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.486559:0:14925:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784044245.486562:0:14925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044245.486564:0:14925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.486565:0:14925:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784044245.486568:0:14925:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904bfb3aa800 00000020:00000080:3.0:1784044245.486570:0:14925:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044245.486622:0:14925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044245.486625:0:14925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.486626:0:14925:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784044245.486628:0:14925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044245.486630:0:14925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.486631:0:14925:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784044245.486634:0:14925:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff904bfb3aa800 00000020:00000080:3.0:1784044245.486636:0:14925:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044245.486665:0:14925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044245.486669:0:14925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044245.486670:0:14925:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784044245.486672:0:14925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1784044245.489274:0:14907:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1784044245.489312:0:14907:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044245.489336:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.489360:0:14907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044245.489405:0:14907:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784044245.489408:0:14907:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff904bfb3aa800 10000000:01000000:3.0:1784044245.489411:0:14907:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff904bfb3aa800 10000000:01000000:3.0:1784044245.489415:0:14907:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044245.489420:0:14907:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904bfb3aa800 from 1 10000000:01000000:3.0:1784044245.489423:0:14907:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784044245.489458:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9a400/0x9cc73983a75511b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.489466:0:14907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bffa9a400/0x9cc73983a75511b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.489478:0:14907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bffa9a400/0x9cc73983a75511b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044245.489501:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044245.489560:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.489594:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe180 going to sleep for 11 seconds 00000100:00100000:0.0:1784044245.489680:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598752000 00000100:00100000:0.0:1784044245.489686:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598752000 00000100:00100000:0.0:1784044245.489735:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784044245.489744:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598752000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044245.489755:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044245.489773:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee7000/0x9cc73983a75511bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a75511b5 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.489795:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee7000/0x9cc73983a75511bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a75511b5 expref: 16 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.489807:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee7000/0x9cc73983a75511bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75511b5 expref: 16 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.489816:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7000, rc 0) 00000100:00100000:0.0:1784044245.489849:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14907:x1870705598752000:12345-0@lo:101:mount.lustre.0 Request processed in 107us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.489857:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784044245.491212:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044245.491234:0:14907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bffa9a400/0x9cc73983a75511b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75511bc expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044245.491246:0:14907:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bffa9a400/0x9cc73983a75511b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75511bc expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044245.491894:0:14907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1784044245.492296:0:14907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044245.492543:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784044245.492587:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1784044245.492618:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1784044245.492660:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1784044245.492692:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1784044245.492732:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1784044245.492763:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1784044245.492793:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1784044245.492833:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1784044245.492893:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1784044245.492941:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1784044245.492984:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1784044245.493016:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1784044245.493046:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1784044245.493085:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1784044245.493132:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1784044245.493167:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1784044245.493210:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1784044245.493241:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1784044245.493271:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1784044245.493311:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1784044245.493341:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1784044245.493375:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1784044245.493435:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1784044245.493474:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1784044245.493504:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1784044245.493576:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1784044245.493612:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1784044245.493674:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1784044245.493687:0:14907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1784044245.493774:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044245.493834:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.495409:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044245.501685:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598752128 00000100:00100000:2.0:1784044245.501702:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598752128 00000100:00100000:2.0:1784044245.502413:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784044245.502425:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14907:x1870705598752128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044245.502716:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14907:x1870705598752128:12345-0@lo:501:mount.lustre.0 Request processed in 292us (8879us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044245.502723:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044245.504480:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044245.504536:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044245.504595:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.504677:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044245.510314:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598752256 00000100:00100000:2.0:1784044245.510337:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598752256 00000100:00100000:3.0:1784044245.510475:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044245.510485:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14907:x1870705598752256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044245.510836:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14907:x1870705598752256:12345-0@lo:503:mount.lustre.0 Request processed in 352us (6240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044245.510845:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044245.510930:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784044245.512665:0:14907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044245.512752:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044245.512816:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.512849:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7ebe180 going to sleep for 11 seconds 00000100:00100000:3.0:1784044245.512884:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598752384 00000100:00100000:3.0:1784044245.512889:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598752384 00000100:00100000:3.0:1784044245.512927:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784044245.512935:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14907:x1870705598752384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044245.516241:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14907:x1870705598752384:12345-0@lo:502:mount.lustre.0 Request processed in 3299us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044245.516256:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784044245.517088:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044245.517585:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1784044245.517653:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1784044245.517690:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1784044245.517739:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1784044245.517777:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1784044245.517827:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1784044245.517916:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1784044245.517958:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1784044245.518003:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1784044245.518035:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1784044245.518065:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1784044245.518146:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1784044245.519773:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1784044245.519825:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1784044245.519956:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1784044245.519996:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1784044245.520030:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1784044245.520076:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1784044245.521295:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1784044245.521359:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1784044245.521421:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1784044245.521457:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1784044245.521488:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1784044245.521556:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1784044245.521597:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1784044245.521631:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1784044245.521679:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1784044245.521733:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1784044245.521768:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1784044245.521832:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1784044245.521894:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1784044245.521932:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1784044245.521965:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1784044245.522028:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1784044245.522066:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1784044245.522127:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1784044245.522587:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1784044245.522630:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1784044245.522675:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1784044245.522707:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1784044245.522757:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044245.522834:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044245.522912:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd074f240 going to sleep for 11 seconds 00000100:00100000:2.0:1784044245.523408:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598752512 00000100:00100000:2.0:1784044245.523417:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598752512 00000100:00100000:2.0:1784044245.523481:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784044245.523491:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14907:x1870705598752512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044245.523745:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14907:x1870705598752512:12345-0@lo:502:mount.lustre.0 Request processed in 254us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044245.523755:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784044245.523857:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044245.524266:0:14907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1784044245.524281:0:14907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1784044245.526482:0:14930:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784044245.526499:0:14930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff904bed5c0000) 00000020:00000080:1.0:1784044245.526527:0:14930:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1784044245.526648:0:14930:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904bfb3aa800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784044245.526652:0:14930:0:(tgt_mount.c:187:server_put_mount()) put mount ffff904bfb3aa800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784044245.526655:0:14930:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904bfb3aa800 3 00010000:00080000:1.0:1784044245.526683:0:14930:0:(ldlm_lib.c:102:import_set_conn()) imp ffff904bc728a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.150@tcp at head 00010000:00010000:3.0:1784044245.531657:0:14930:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1784044245.531773:0:14930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784044245.531812:0:14930:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784044245.531825:0:14930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9cc73983a75511ca 00000100:00080000:3.0:1784044245.531836:0:14930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044245.531842:0:14930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff904bc728a000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1784044245.531910:0:14930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bfb44ed80 x1870705598752640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044245.531938:0:14930:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784044245.532155:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1870705598752640:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784044245.532236:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784044245.532295:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044245.532299:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044245.532302:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044245.532305:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784044245.532357:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598752768:0@lo:400:kworker.0 00000100:00100000:0.0:1784044245.532383:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044245.532424:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598752640 00000100:00100000:0.0:1784044245.532433:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598752640 00000100:00100000:0.0:1784044245.532461:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598752768 00000100:00100000:0.0:1784044245.532463:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598752768 00000100:00100000:0.0:1784044245.532487:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044245.532495:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598752768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044245.532552:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598752768:12345-0@lo:400:kworker.0 Request processed in 56us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.532560:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044245.532575:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044245.532580:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1870705598752640:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784044245.532599:0:14273:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:0.0:1784044245.532627:0:14273:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9cc73983a75511d1 00000004:00100000:0.0:1784044245.532641:0:14273:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784044245.532667:0:14273:0:(import.c:65:import_set_state_nolock()) ffff904bc7f79800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044245.532703:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870705598752640:12345-0@lo:38:llog_process_th.0 Request processed in 122us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.532709:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784044245.532742:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff904bf5ba0380 x1870705598752768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044245.532755:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598752768:0@lo:400:kworker.0 00010000:00080000:0.0:1784044245.532782:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff904bfb44ed80 x1870705598752640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044245.532790:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044245.532796:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1784044245.532802:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784044245.532807:0:3287:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784044245.532809:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bc728a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784044245.532814:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1870705598752640:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1784044245.534539:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1784044245.544077:0:14907:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784044245.544276:0:14907:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784044245.544311:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9a400/0x9cc73983a75511b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75511bc expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.544324:0:14907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bffa9a400/0x9cc73983a75511b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75511bc expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784044245.544466:0:14907:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784044245.544469:0:14907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784044245.544470:0:14907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044245.544472:0:14907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044245.544474:0:14907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044245.544475:0:14907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044245.544477:0:14907:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784044245.544479:0:14907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044245.544480:0:14907:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784044245.544484:0:14907:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1784044245.544487:0:14907:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784044245.544488:0:14907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784044245.544489:0:14907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044245.544490:0:14907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044245.544491:0:14907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044245.544492:0:14907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044245.544493:0:14907:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784044245.544494:0:14907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044245.544495:0:14907:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784044245.544542:0:14907:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784044245.544565:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784044245.544640:0:14907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044245.544682:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd4232d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044245.545911:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598752896 00000100:00100000:0.0:1784044245.545922:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598752896 00000100:00100000:0.0:1784044245.545984:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044245.545994:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14907:x1870705598752896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784044245.546039:0:14267:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784044245.546054:0:14267:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784044245.571753:0:14267:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784044245.571777:0:14267:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784044245.571850:0:14289:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784044245.571856:0:14289:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784044245.571903:0:14289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.571924:0:14289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc81f5200/0x9cc73983a7551145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755113e expref: 16 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.571931:0:14289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.571972:0:14289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc81f5200/0x9cc73983a7551145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a755113e expref: 16 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044245.571987:0:14289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904bc81f5200/0x9cc73983a7551145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a755113e expref: 16 pid: 14265 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044245.572002:0:14289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14289:1870705598753024:0@lo:104: 00000100:00100000:0.0:1784044245.572070:0:14289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044245.572129:0:14289:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd42323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044245.572967:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598753024 00000100:00100000:1.0:1784044245.572978:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598753024 00000100:00100000:1.0:1784044245.573031:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044245.573041:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+3:14289:x1870705598753024:12345-0@lo:104: 00010000:00010000:1.0:1784044245.573056:0:14257:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573136:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044245.573142:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+3:14289:x1870705598753024:12345-0@lo:104: Request processed in 104us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044245.573149:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1784044245.573274:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044245.573280:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573287:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:1.0:1784044245.573293:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573302:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044245.573309:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044245.573329:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784044245.573370:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573378:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044245.573400:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573406:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a755113e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551145 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573424:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044245.573426:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044245.573428:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044245.573441:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598753152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044245.573477:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044245.573527:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598753152 00000100:00100000:1.0:1784044245.573531:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598753152 00010000:00010000:1.0:1784044245.573551:0:14260:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc81f5200/0x9cc73983a7551145 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a755113e expref: 17 pid: 14265 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044245.573572:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044245.573579:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:3289:x1870705598753152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044245.573590:0:14260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044245.573595:0:14260:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc81f5200/0x9cc73983a7551145 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a755113e expref: 17 pid: 14265 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573605:0:14260:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc81f5200/0x9cc73983a7551145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a755113e expref: 17 pid: 14265 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573630:0:14260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573639:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784044245.573743:0:14260:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001887127s 00010000:00010000:1.0:1784044245.573748:0:14260:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573756:0:14260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573762:0:14260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573768:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573773:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044245.573776:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573783:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573792:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573802:0:14260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044245.573906:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:3289:x1870705598753152:12345-0@lo:103:ldlm_bl.0 Request processed in 328us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044245.573920:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1784044245.573958:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f5200/0x9cc73983a7551145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a755113e expref: 16 pid: 14265 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044245.573969:0:14289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14289:1870705598753024:0@lo:104: 00010000:00010000:1.0:1784044245.573989:0:14289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.573998:0:14289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.574005:0:14289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044245.574011:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beeee6600/0x9cc73983a75511d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044245.575423:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598753152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044245.582942:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14907:x1870705598752896:12345-0@lo:253:mount.lustre.0 Request processed in 36940us (38292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044245.582958:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784044245.583087:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:14907:1870705598752896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784044245.583113:0:14907:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784044245.583117:0:14907:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784044245.583119:0:14907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784044245.583120:0:14907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784044245.583121:0:14907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784044245.583123:0:14907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784044245.583124:0:14907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784044245.583125:0:14907:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784044245.583127:0:14907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784044245.583129:0:14907:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784044245.583145:0:14907:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784044245.598530:0:14907:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784044245.598667:0:14907:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784044245.598795:0:14907:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784044245.598948:0:14907:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784044245.599064:0:14907:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784044245.599280:0:14907:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784044245.603724:0:14907:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784044245.682042:0:14907:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784044245.682052:0:14907:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784044245.682086:0:14907:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784044245.682171:0:14907:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784044245.682202:0:14907:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784044245.682233:0:14907:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1784044246.244511:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784044246.941992:0:14269:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784044246.942000:0:14269:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff904bc7f70800 from 7 10000000:01000000:0.0:1784044246.942004:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784044246.942054:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044246.942066:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044246.942087:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044246.942115:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598753280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044246.942183:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044246.942246:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5145240 going to sleep for 11 seconds 00000100:00100000:1.0:1784044246.942323:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598753280 00000100:00100000:1.0:1784044246.942331:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598753280 00000100:00100000:1.0:1784044246.942394:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044246.942404:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+15:14269:x1870705598753280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044246.942417:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044246.942431:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beb0fc800/0x9cc73983a75511e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a75511df expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044246.942454:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beb0fc800/0x9cc73983a75511e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a75511df expref: 16 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044246.942465:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beb0fc800/0x9cc73983a75511e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75511df expref: 16 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044246.942473:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc800, rc 0) 00000100:00100000:1.0:1784044246.942517:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14269:x1870705598753280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044246.942523:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044246.942568:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598753280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044246.942582:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044246.942590:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044246.942638:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598753408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784044246.942665:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044246.942676:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc8979cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044246.942841:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598753408 00000100:00100000:0.0:1784044246.942846:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598753408 00000100:00100000:0.0:1784044246.942903:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784044246.942911:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14269:x1870705598753408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784044246.942925:0:14265:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784044246.942943:0:14265:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784044246.942946:0:14265:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1784044246.943023:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14269:x1870705598753408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044246.943031:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784044246.943125:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598753408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784044246.943177:0:14269:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784044246.943184:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044246.943193:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044247.265054:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044248.291810:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044249.312808:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044250.335884:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044251.044860:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044251.044892:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044251.044895:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044251.044898:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784044251.044971:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598753792:0@lo:400:kworker.0 00000100:00100000:3.0:1784044251.045082:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044251.045175:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598753792 00000100:00100000:3.0:1784044251.045184:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598753792 00000100:00100000:2.0:1784044251.045673:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d72db5ce-ca39-4323-bf26-8b60fe27b493:3290:1870705598753536:0@lo:400:kworker.0 00000100:00100000:2.0:1784044251.045715:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044251.045754:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044251.045762:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598753664:0@lo:400:kworker.0 00000100:00100000:2.0:1784044251.045788:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044251.045826:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598753536 00000100:00100000:2.0:1784044251.045830:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598753536 00000100:00100000:2.0:1784044251.045857:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784044251.045892:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:3290:x1870705598753536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044251.045944:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:3290:x1870705598753536:12345-0@lo:400:kworker.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044251.045952:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784044251.046006:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598753664 00000100:00100000:2.0:1784044251.046009:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598753664 00000100:00100000:2.0:1784044251.046030:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784044251.046037:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598753792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044251.046076:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870705598753792:12345-0@lo:400:kworker.0 Request processed in 40us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044251.046082:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784044251.046098:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784044251.046104:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598753664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044251.046131:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598753664:12345-0@lo:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044251.046138:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784044251.046176:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bfb44e680 x1870705598753664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044251.046192:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598753664:0@lo:400:kworker.0 00000100:00100000:2.0:1784044251.046201:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d72db5ce-ca39-4323-bf26-8b60fe27b493:3290:1870705598753536:0@lo:400:kworker.0 00010000:00080000:2.0:1784044251.046264:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bfb44c700 x1870705598753792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044251.046273:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1870705598753792:0@lo:400:kworker.0 00000100:00080000:0.0:1784044251.046681:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784044251.359736:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044252.387700:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784044252.650687:0:15273:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784044253.408294:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044254.431989:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044254.878557:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044255.454378:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044256.165844:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044256.165853:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044256.165855:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044256.165858:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784044256.167183:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044256.167213:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d72db5ce-ca39-4323-bf26-8b60fe27b493:3288:1870705598753920:0@lo:400:kworker.0 00000100:00100000:0.0:1784044256.167287:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044256.167346:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598754048:0@lo:400:kworker.0 00000100:00100000:0.0:1784044256.167373:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044256.167395:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044256.167401:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598754176:0@lo:400:kworker.0 00000100:00100000:0.0:1784044256.167421:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044256.167453:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598753920 00000100:00100000:0.0:1784044256.167461:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598753920 00000100:00100000:0.0:1784044256.168771:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784044256.168787:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:3288:x1870705598753920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044256.168875:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:3288:x1870705598753920:12345-0@lo:400:kworker.0 Request processed in 79us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044256.168884:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784044256.168938:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598754048 00000100:00100000:0.0:1784044256.168945:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598754048 00000100:00100000:0.0:1784044256.168976:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598754176 00000100:00100000:0.0:1784044256.168979:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598754176 00000100:00100000:0.0:1784044256.169001:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044256.169006:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598754048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044256.169046:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598754048:12345-0@lo:400:kworker.0 Request processed in 38us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044256.169070:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044256.169083:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044256.169089:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598754176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044256.169120:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598754176:12345-0@lo:400:kworker.0 Request processed in 30us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044256.169125:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1784044256.169149:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784044256.169181:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bf5ba0000 x1870705598754176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044256.169196:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598754176:0@lo:400:kworker.0 00010000:00080000:0.0:1784044256.169207:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bf5ba0700 x1870705598754048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044256.169215:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598754048:0@lo:400:kworker.0 00000100:00100000:0.0:1784044256.169248:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d72db5ce-ca39-4323-bf26-8b60fe27b493:3288:1870705598753920:0@lo:400:kworker.0 00010000:00010000:1.0:1784044256.479983:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044257.505067:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044257.832411:0:3287:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044242/real 1784044242] req@ffff904bf5ba3b80 x1870705598749952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044257 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044257.832446:0:3287:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff904bf5ba3b80 x1870705598749952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044257 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044257.832457:0:3287:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044242/real 1784044242] req@ffff904bf5ba2d80 x1870705598750080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044257 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044257.832469:0:3287:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff904bf5ba2d80 x1870705598750080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044257 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784044257.832505:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bed26f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044257.832537:0:3287:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784044257.832541:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598749952:0@lo:8:kworker.0 00000100:00080000:0.0:1784044257.832548:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904ac3627000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044257.832553:0:3287:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784044257.832556:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598750080:0@lo:8:kworker.0 00000100:00080000:3.0:1784044257.832926:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044257.832930:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784044257.832933:0:37:0:(import.c:65:import_set_state_nolock()) ffff904bed26f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044257.832938:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:3.0:1784044257.832943:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784044257.832950:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff904bed26f000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1784044257.832971:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bfb44c700 x1870705598754432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044257.832981:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044257.832984:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784044257.832986:0:37:0:(import.c:65:import_set_state_nolock()) ffff904ac3627000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044257.832989:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:3.0:1784044257.832991:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784044257.832994:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff904ac3627000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1784044257.833003:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bfb44ca80 x1870705598754560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044257.833043:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598754688:0@lo:400:kworker.0 00000100:00100000:3.0:1784044257.833101:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044257.833156:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044257.833163:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598754304:0@lo:400:kworker.0 00000100:00100000:3.0:1784044257.833206:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044257.833834:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598754816:0@lo:400:kworker.0 00000100:00100000:0.0:1784044257.833891:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044257.833935:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598754688 00000100:00100000:0.0:1784044257.833942:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598754688 00000100:00100000:0.0:1784044257.833982:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598754816 00000100:00100000:0.0:1784044257.833986:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598754816 00000100:00100000:0.0:1784044257.834002:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044257.834010:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598754688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044257.834060:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598754688:12345-0@lo:400:kworker.0 Request processed in 50us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044257.834068:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044257.834083:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044257.834090:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598754816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044257.834119:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598754816:12345-0@lo:400:kworker.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044257.834124:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044257.834141:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598754304 00000100:00100000:0.0:1784044257.834144:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598754304 00000100:00100000:0.0:1784044257.834165:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784044257.834176:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:3289:x1870705598754304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044257.834219:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:3289:x1870705598754304:12345-0@lo:400:kworker.0 Request processed in 44us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044257.834225:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1784044257.834270:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bfb44ed80 x1870705598754816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044257.834283:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598754816:0@lo:400:kworker.0 00000100:00100000:0.0:1784044257.834305:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598754432:0@lo:8:kworker.0 00000100:00100000:0.0:1784044257.834475:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044257.834501:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598754560:0@lo:8:kworker.0 00000100:00100000:0.0:1784044257.834520:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044257.834551:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598754304:0@lo:400:kworker.0 00010000:00080000:0.0:1784044257.834561:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bfb44e680 x1870705598754688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044257.834569:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598754688:0@lo:400:kworker.0 00000100:00100000:3.0:1784044257.834686:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598754432 00000100:00100000:3.0:1784044257.834690:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598754432 00000100:00100000:3.0:1784044257.834713:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598754560 00000100:00100000:3.0:1784044257.834716:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598754560 00000100:00100000:3.0:1784044257.834725:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044257.834729:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1870705598754432:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1784044257.834749:0:14909:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:3.0:1784044257.834773:0:14909:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9cc73983a75511ed 00002000:00100000:3.0:1784044257.834785:0:14909:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff904bcff24800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784044257.834788:0:14909:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784044257.834790:0:14909:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784044257.835109:0:14909:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784044257.835131:0:14909:0:(import.c:65:import_set_state_nolock()) ffff904bcff26000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044257.835169:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1870705598754432:12345-0@lo:8:kworker.0 Request processed in 439us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044257.835176:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044257.835300:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044257.835307:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1870705598754560:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784044257.835440:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bfb44c700 x1870705598754432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044257.835450:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044257.835457:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784044257.835464:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784044257.835469:0:3287:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784044257.835472:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bed26f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784044257.835487:0:3287:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784044257.835503:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598754432:0@lo:8:kworker.0 00010000:00020000:3.0:1784044257.836353:0:14909:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784044257.836957:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1870705598754560:12345-0@lo:8:kworker.0 Request processed in 1646us (2433us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784044257.836968:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784044257.838577:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598754944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044257.838646:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044257.840678:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598754944 00000100:00100000:0.0:1784044257.840693:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598754944 00000100:00100000:0.0:1784044257.840754:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784044257.840765:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1870705598754944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044257.840801:0:14912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000004:00080000:1.0:1784044257.845941:0:14295:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784044257.847163:0:14295:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 435832296267ns, next at 0ns, rc = 0 00000100:00080000:1.0:1784044257.847395:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904ac3627000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044257.847405:0:3287:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044257.847410:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598754560:0@lo:8:kworker.0 00000004:00080000:1.0:1784044257.847438:0:14296:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1784044257.847476:0:14296:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14296:1870705598755072:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784044257.847545:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044257.847582:0:14296:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd1253cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044257.849678:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1870705598754944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8907us (11023us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044257.849692:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784044257.849746:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598755072 00000100:00100000:0.0:1784044257.849754:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598755072 00000100:00100000:0.0:1784044257.849788:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044257.849795:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14296:x1870705598755072:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1784044257.851834:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904bf5ba0700 x1870705598754944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044257.851898:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598754944:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1784044257.854081:0:14911:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1784044257.854092:0:14911:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1784044257.854096:0:14911:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1784044257.866586:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044257.866597:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6534a8b/0x9cc73983a75511f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.866616:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1784044257.866620:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044257.866626:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6534a8b/0x9cc73983a75511f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.866643:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6534a8b/0x9cc73983a75511f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.866662:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6534a8b/0x9cc73983a75511f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.866670:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6534a8b/0x9cc73983a75511f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.866691:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784044257.867196:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044257.867203:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bacd9683/0x9cc73983a75511fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.867213:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1784044257.867217:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044257.867221:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bacd9683/0x9cc73983a75511fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.867232:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bacd9683/0x9cc73983a75511fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.867240:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bacd9683/0x9cc73983a75511fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.867248:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bacd9683/0x9cc73983a75511fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.867275:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784044257.867674:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044257.867680:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5023431/0x9cc73983a7551202 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.867689:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1784044257.867692:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044257.867697:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5023431/0x9cc73983a7551202 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.867706:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5023431/0x9cc73983a7551202 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.867715:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5023431/0x9cc73983a7551202 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.867721:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044257.867723:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5023431/0x9cc73983a7551202 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.867731:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6534a8b/0x9cc73983a75511f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.867734:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784044257.867746:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.867751:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6534a8b/0x9cc73983a75511f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.867761:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6534a8b/0x9cc73983a75511f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.867787:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6534a8b/0x9cc73983a75511f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.867807:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6534a8b/0x9cc73983a75511f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.867832:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:0.0:1784044257.868150:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044257.868156:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a7551209 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.868165:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1784044257.868172:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044257.868178:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a7551209 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868180:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bacd9683/0x9cc73983a75511fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.868196:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a7551209 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868197:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.868203:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bacd9683/0x9cc73983a75511fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.868209:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a7551209 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868217:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bacd9683/0x9cc73983a75511fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.868220:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a7551209 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.868239:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784044257.868242:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bacd9683/0x9cc73983a75511fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868251:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bacd9683/0x9cc73983a75511fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868269:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044257.868272:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5023431/0x9cc73983a7551202 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868279:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.868292:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5023431/0x9cc73983a7551202 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868301:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5023431/0x9cc73983a7551202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868314:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5023431/0x9cc73983a7551202 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868322:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5023431/0x9cc73983a7551202 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868339:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044257.868343:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a7551209 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868350:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.868355:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a7551209 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868363:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a7551209 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868373:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a7551209 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868381:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a7551209 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.868406:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.868409:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.868413:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044257.868660:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044257.868667:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7551210 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.868675:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1784044257.868678:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044257.868682:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7551210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.868691:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7551210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.868699:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7551210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.868711:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7551210 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.868734:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784044257.869111:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044257.869117:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d6fa30/0x9cc73983a7551217 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869125:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1784044257.869128:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044257.869133:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d6fa30/0x9cc73983a7551217 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869142:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d6fa30/0x9cc73983a7551217 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869150:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d6fa30/0x9cc73983a7551217 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869157:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d6fa30/0x9cc73983a7551217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869165:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00080000:0.0:1784044257.869297:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784044257.869331:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044257.869337:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7551210 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869351:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6a00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044257.869356:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7551210 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869364:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7551210 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869377:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7551210 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869384:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d8135c3/0x9cc73983a7551210 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869399:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044257.869402:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d6fa30/0x9cc73983a7551217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869409:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044257.869412:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d6fa30/0x9cc73983a7551217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869420:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d6fa30/0x9cc73983a7551217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869430:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d6fa30/0x9cc73983a7551217 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869443:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d6fa30/0x9cc73983a7551217 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869460:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044257.869462:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044257.869463:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044257.869788:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044257.869794:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da71bb6b/0x9cc73983a755121e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869802:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1784044257.869806:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044257.869812:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da71bb6b/0x9cc73983a755121e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869821:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da71bb6b/0x9cc73983a755121e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869830:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da71bb6b/0x9cc73983a755121e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869837:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da71bb6b/0x9cc73983a755121e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.869851:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044257.869858:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044257.870154:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.872525:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.872539:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7551225 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.872556:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.872561:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.872568:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7551225 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.872584:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7551225 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.872603:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7551225 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.872611:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7551225 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.872625:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044257.873792:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da71bb6b/0x9cc73983a755121e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.873806:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044257.873811:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da71bb6b/0x9cc73983a755121e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.873822:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da71bb6b/0x9cc73983a755121e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.873844:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da71bb6b/0x9cc73983a755121e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.873852:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da71bb6b/0x9cc73983a755121e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.873925:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044257.873930:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7551225 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.873936:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044257.873940:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7551225 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.873947:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7551225 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.873969:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7551225 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.873977:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b82b646e/0x9cc73983a7551225 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044257.873992:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044257.873994:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044257.873997:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.875582:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.875593:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755122c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.875619:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.875624:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.875631:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755122c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.875646:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755122c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.875655:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755122c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.875663:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755122c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.875692:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044257.875905:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044257.875912:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755122c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.875922:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fda00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044257.875927:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755122c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.875937:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755122c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.875958:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755122c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.875966:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755122c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.875991:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044257.875993:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044257.875995:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.878160:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.878175:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2dba3e5/0x9cc73983a7551233 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.878192:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.878197:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.878204:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2dba3e5/0x9cc73983a7551233 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.878218:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2dba3e5/0x9cc73983a7551233 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.878241:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2dba3e5/0x9cc73983a7551233 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.878250:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2dba3e5/0x9cc73983a7551233 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.878280:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044257.878326:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044257.878333:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2dba3e5/0x9cc73983a7551233 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.878342:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fde00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044257.878353:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2dba3e5/0x9cc73983a7551233 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.878361:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2dba3e5/0x9cc73983a7551233 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.878377:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2dba3e5/0x9cc73983a7551233 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.878385:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2dba3e5/0x9cc73983a7551233 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.878405:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044257.878406:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044257.878409:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.878776:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.878782:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000855576f8/0x9cc73983a755123a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.878791:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.878794:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.878798:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000855576f8/0x9cc73983a755123a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.878806:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000855576f8/0x9cc73983a755123a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.878814:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000855576f8/0x9cc73983a755123a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.878820:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000855576f8/0x9cc73983a755123a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.878850:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044257.878926:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044257.878931:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000855576f8/0x9cc73983a755123a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.878940:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd400 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044257.878943:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000855576f8/0x9cc73983a755123a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.878951:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000855576f8/0x9cc73983a755123a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.878962:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000855576f8/0x9cc73983a755123a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.878975:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000855576f8/0x9cc73983a755123a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.878990:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044257.878991:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044257.878993:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.881765:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.881776:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6ef7709/0x9cc73983a7551241 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.881794:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.881799:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.881806:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ef7709/0x9cc73983a7551241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.881821:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6ef7709/0x9cc73983a7551241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.881832:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6ef7709/0x9cc73983a7551241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.882399:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ef7709/0x9cc73983a7551241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.882426:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044257.882517:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044257.882526:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6ef7709/0x9cc73983a7551241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.882537:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044257.882542:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6ef7709/0x9cc73983a7551241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.882553:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6ef7709/0x9cc73983a7551241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.882575:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6ef7709/0x9cc73983a7551241 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.882584:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6ef7709/0x9cc73983a7551241 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.882609:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.882622:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.882625:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.882981:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.882987:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd154c1/0x9cc73983a7551248 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.882997:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.883006:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.883011:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd154c1/0x9cc73983a7551248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.883299:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfd154c1/0x9cc73983a7551248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.883309:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd154c1/0x9cc73983a7551248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.883317:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd154c1/0x9cc73983a7551248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.883342:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044257.883370:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044257.883378:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfd154c1/0x9cc73983a7551248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.883387:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fca00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044257.883390:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd154c1/0x9cc73983a7551248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.883398:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd154c1/0x9cc73983a7551248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.883411:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfd154c1/0x9cc73983a7551248 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.883418:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfd154c1/0x9cc73983a7551248 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.883438:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.883441:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.883443:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.884274:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.884282:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d168eaf/0x9cc73983a755124f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884296:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.884301:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.884307:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d168eaf/0x9cc73983a755124f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884319:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d168eaf/0x9cc73983a755124f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884327:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d168eaf/0x9cc73983a755124f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884341:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d168eaf/0x9cc73983a755124f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884368:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044257.884848:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.884855:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8efe38d/0x9cc73983a7551256 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884888:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.884893:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.884898:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8efe38d/0x9cc73983a7551256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884908:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8efe38d/0x9cc73983a7551256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884915:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8efe38d/0x9cc73983a7551256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884921:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8efe38d/0x9cc73983a7551256 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884935:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784044257.884946:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044257.884951:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d168eaf/0x9cc73983a755124f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884966:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.884970:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d168eaf/0x9cc73983a755124f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884979:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d168eaf/0x9cc73983a755124f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.884994:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d168eaf/0x9cc73983a755124f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885001:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d168eaf/0x9cc73983a755124f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885032:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044257.885036:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8efe38d/0x9cc73983a7551256 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885043:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fce00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.885046:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8efe38d/0x9cc73983a7551256 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885052:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8efe38d/0x9cc73983a7551256 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885061:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8efe38d/0x9cc73983a7551256 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885074:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8efe38d/0x9cc73983a7551256 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885088:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.885091:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.885093:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.885581:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.885587:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029deb9f6/0x9cc73983a755125d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885596:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.885600:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.885603:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029deb9f6/0x9cc73983a755125d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885611:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029deb9f6/0x9cc73983a755125d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885618:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029deb9f6/0x9cc73983a755125d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885624:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029deb9f6/0x9cc73983a755125d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.885647:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044257.885745:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044257.885753:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029deb9f6/0x9cc73983a755125d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.885762:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044257.885766:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029deb9f6/0x9cc73983a755125d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.885782:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029deb9f6/0x9cc73983a755125d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.885796:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029deb9f6/0x9cc73983a755125d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.885803:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029deb9f6/0x9cc73983a755125d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.885823:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.885826:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.885829:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044257.887386:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.891469:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.891490:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f4f2a/0x9cc73983a7551264 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.891510:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.891514:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.891522:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f4f2a/0x9cc73983a7551264 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.891536:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f4f2a/0x9cc73983a7551264 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.891546:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f4f2a/0x9cc73983a7551264 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.891555:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f4f2a/0x9cc73983a7551264 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.891577:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044257.892210:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.892218:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755126b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.892228:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.892232:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.892236:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755126b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.892246:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755126b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.892261:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755126b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.892376:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044257.892385:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f4f2a/0x9cc73983a7551264 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.892396:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd800 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044257.892401:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f4f2a/0x9cc73983a7551264 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.892412:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f4f2a/0x9cc73983a7551264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.892433:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f4f2a/0x9cc73983a7551264 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.892455:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f4f2a/0x9cc73983a7551264 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.892475:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.892477:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.892623:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.896153:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755126b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.896179:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044257.896197:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044257.896203:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755126b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.896211:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662800 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.896215:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755126b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.896226:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755126b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.896248:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755126b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.896255:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755126b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.896289:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.896298:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.896300:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.897197:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.897206:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c432fd04/0x9cc73983a7551272 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.897219:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.897224:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.897230:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c432fd04/0x9cc73983a7551272 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.897242:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c432fd04/0x9cc73983a7551272 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.897251:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c432fd04/0x9cc73983a7551272 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.897258:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c432fd04/0x9cc73983a7551272 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.897275:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044257.898282:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.898290:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a7551279 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.898301:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.898305:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.898310:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a7551279 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.898327:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a7551279 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.898337:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a7551279 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.898345:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a7551279 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.898365:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784044257.898380:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044257.898838:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c432fd04/0x9cc73983a7551272 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.898995:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.899000:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c432fd04/0x9cc73983a7551272 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.899009:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c432fd04/0x9cc73983a7551272 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.899025:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c432fd04/0x9cc73983a7551272 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.899032:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c432fd04/0x9cc73983a7551272 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.899057:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044257.899061:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a7551279 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.899068:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.899072:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a7551279 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.899079:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a7551279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.899089:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a7551279 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.899096:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a7551279 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.899109:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.899110:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.899112:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.900261:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.900282:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007afe30cd/0x9cc73983a7551280 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.900296:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.900301:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.900312:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007afe30cd/0x9cc73983a7551280 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.900325:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007afe30cd/0x9cc73983a7551280 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.900333:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007afe30cd/0x9cc73983a7551280 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.900340:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007afe30cd/0x9cc73983a7551280 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.900364:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044257.900507:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044257.900513:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007afe30cd/0x9cc73983a7551280 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.900521:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663400 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044257.900525:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007afe30cd/0x9cc73983a7551280 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.900534:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007afe30cd/0x9cc73983a7551280 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.900555:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007afe30cd/0x9cc73983a7551280 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.900563:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007afe30cd/0x9cc73983a7551280 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.900570:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.900772:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.900775:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.900777:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.903360:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.903372:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a7551287 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.903389:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.903393:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.903400:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a7551287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.903414:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a7551287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.903423:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a7551287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.903442:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a7551287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.903460:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044257.903473:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044257.903479:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a7551287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.903487:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663a00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.903491:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a7551287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.903500:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a7551287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.903516:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a7551287 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.903524:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a7551287 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.903541:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.903543:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.903544:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.905300:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.905321:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755128e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.905335:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.905339:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.905345:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755128e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.905358:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755128e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.905368:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755128e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.905376:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755128e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.905394:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044257.906025:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044257.906055:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755128e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.906065:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662800 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044257.906070:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755128e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.906193:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755128e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.906213:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755128e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.906221:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e59a3ce3/0x9cc73983a755128e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.906243:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.906245:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.906247:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.906737:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.906744:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007362186b/0x9cc73983a7551295 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.906754:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.906759:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.906764:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007362186b/0x9cc73983a7551295 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.906774:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007362186b/0x9cc73983a7551295 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.906790:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007362186b/0x9cc73983a7551295 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.906797:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007362186b/0x9cc73983a7551295 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.906815:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044257.906826:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044257.906831:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007362186b/0x9cc73983a7551295 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.906838:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.906841:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007362186b/0x9cc73983a7551295 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.906849:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007362186b/0x9cc73983a7551295 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.907802:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007362186b/0x9cc73983a7551295 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.907820:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007362186b/0x9cc73983a7551295 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.907846:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.907855:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044257.907857:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.908470:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.908478:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ee56bd6/0x9cc73983a755129c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.908490:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.908494:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.908500:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ee56bd6/0x9cc73983a755129c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.908512:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ee56bd6/0x9cc73983a755129c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.908521:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ee56bd6/0x9cc73983a755129c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.908529:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ee56bd6/0x9cc73983a755129c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.908549:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044257.908710:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044257.908717:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ee56bd6/0x9cc73983a755129c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.908726:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044257.908731:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ee56bd6/0x9cc73983a755129c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.908740:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ee56bd6/0x9cc73983a755129c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.908755:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ee56bd6/0x9cc73983a755129c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.908763:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ee56bd6/0x9cc73983a755129c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044257.908779:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044257.908781:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044257.909099:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.909107:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a75512a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.909116:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.909119:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044257.909124:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a75512a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.909140:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a75512a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.909148:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a75512a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.909156:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a75512a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.909179:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044257.909318:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044257.909346:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.909597:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a75512a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.909609:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663a00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044257.909613:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a75512a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784044257.909613:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044257.909625:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a75512aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.909640:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1784044257.909647:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044257.909650:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a75512a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.909653:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a75512aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.909674:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a75512aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.909685:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a75512aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.909689:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a75512a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.909703:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bb9435c/0x9cc73983a75512a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044257.909712:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a75512aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.909723:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.909726:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044257.909730:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a75512aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.909738:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044257.909739:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784044257.909742:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a75512aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.909752:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a75512aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.909764:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a75512aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.909772:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d81a9772/0x9cc73983a75512aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044257.909792:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.909795:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044257.909797:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044257.910122:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784044257.910489:0:14911:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1784044257.910814:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14296:x1870705598755072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 61014us (63263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044257.910830:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044257.911206:0:14296:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14296:1870705598755072:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784044257.911223:0:14296:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1784044257.911278:0:14296:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14296:1870705598755200:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784044257.911320:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044257.911388:0:14296:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc30706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044257.911589:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598755200 00000100:00100000:1.0:1784044257.911719:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598755200 00000100:00100000:1.0:1784044257.911766:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044257.911775:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14296:x1870705598755200:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784044257.911816:0:14909:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:3.0:1784044257.916954:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784044257.922922:0:14296:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14296:1870705598755200:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784044257.922953:0:14296:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:1.0:1784044257.923732:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14296:x1870705598755200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11059us (11513us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1784044257.923746:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1784044258.527079:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784044258.902744:0:15575:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784044258.902748:0:15575:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1784044258.917436:0:15575:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff904bcff24000 00000020:01000004:1.0:1784044258.917460:0:15575:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1784044258.917475:0:15575:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1784044258.917491:0:15575:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff904bed5c19c0) 00000020:00000080:1.0:1784044258.917507:0:15575:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784044258.945542:0:15575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784044258.946921:0:15575:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1784044258.947760:0:15575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784044258.948677:0:15575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1784044258.949051:0:15575:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1784044258.949646:0:15575:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 467: rc = 0 00100000:10000000:3.0:1784044258.949750:0:15575:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 467: rc = 0 00100000:10000000:3.0:1784044258.949993:0:15575:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 467: rc = 0 00100000:10000000:3.0:1784044258.951462:0:15575:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1784044258.951727:0:15575:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1784044258.952035:0:15575:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1784044258.952280:0:15575:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1784044258.952524:0:15575:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:3.0:1784044258.952777:0:15575:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:3.0:1784044258.958595:0:15575:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1784044258.958609:0:15575:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784044258.958621:0:15575:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9cc73983a75512b8 00000020:01000004:3.0:1784044258.960302:0:15575:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1784044258.960335:0:15575:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784044258.960352:0:15575:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784044258.960360:0:15575:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1784044258.960389:0:15575:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1784044258.960394:0:15575:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1784044258.976434:0:15575:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784044258.976475:0:15575:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.150@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1784044258.976480:0:15575:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784044258.976481:0:15575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044258.976483:0:15575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044258.976484:0:15575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044258.976740:0:15575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044258.976742:0:15575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044258.976744:0:15575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044258.976745:0:15575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044258.976747:0:15575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784044258.976751:0:15575:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1784044258.976754:0:15575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784044258.976755:0:15575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044258.976756:0:15575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044258.976757:0:15575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044258.976758:0:15575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044258.976760:0:15575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044258.976761:0:15575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044258.976762:0:15575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044258.976763:0:15575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784044258.976792:0:15575:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784044258.977528:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755328:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784044258.977611:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044258.977688:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044258.978653:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598755328 00000100:00100000:0.0:1784044258.978668:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598755328 00000100:00100000:0.0:1784044258.978807:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784044258.978832:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:15575:x1870705598755328:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784044258.978921:0:14265:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784044258.978925:0:14265:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1784044258.978929:0:14265:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1784044259.001031:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:15575:x1870705598755328:12345-0@lo:253:mount.lustre.0 Request processed in 22192us (23411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044259.001047:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784044259.001081:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755328:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784044259.001097:0:15575:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784044259.001101:0:15575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784044259.001103:0:15575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044259.001120:0:15575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044259.001122:0:15575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044259.001123:0:15575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044259.001124:0:15575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044259.001126:0:15575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044259.001128:0:15575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044259.001130:0:15575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784044259.001156:0:15575:0:(tgt_mount.c:101:server_register_mount()) register mount ffff904bcff24000 from lustre-OST0001 10000000:01000000:2.0:1784044259.001185:0:15575:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1784044259.001189:0:15575:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784044259.001198:0:15575:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff904bf5af99c0 local copy 00010000:00010000:2.0:1784044259.001211:0:15575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755106c expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044259.001477:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044259.001514:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044259.001554:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044259.001819:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598755456 00000100:00100000:0.0:1784044259.001828:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598755456 00000100:00100000:0.0:1784044259.001930:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784044259.001948:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:15575:x1870705598755456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044259.002138:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:15575:x1870705598755456:12345-0@lo:501:mount.lustre.0 Request processed in 192us (623us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784044259.002147:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784044259.002266:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755456:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784044259.002288:0:15575:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784044259.002473:0:15575:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784044259.002481:0:15575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755106c expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.002492:0:15575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bffa9a600/0x9cc73983a7551065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755106c expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044259.002517:0:15575:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff904bcff24000 10000000:01000000:3.0:1784044259.002522:0:15575:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784044259.002527:0:15575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784044259.002529:0:15575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044259.002533:0:15575:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784044259.002536:0:15575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784044259.002568:0:15575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75512bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.002577:0:15575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75512bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.002590:0:15575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75512bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044259.002618:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044259.002650:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.002694:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd4232840 going to sleep for 11 seconds 00000100:00100000:2.0:1784044259.002986:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598755584 00000100:00100000:2.0:1784044259.002993:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598755584 00000100:00100000:2.0:1784044259.003036:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784044259.003044:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:15575:x1870705598755584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044259.003056:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044259.003068:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f4c00/0x9cc73983a75512c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a75512bf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044259.003092:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f4c00/0x9cc73983a75512c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a75512bf expref: 17 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044259.003104:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f4c00/0x9cc73983a75512c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75512bf expref: 17 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044259.003112:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4c00, rc 0) 00000100:00100000:2.0:1784044259.003161:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:15575:x1870705598755584:12345-0@lo:101:mount.lustre.0 Request processed in 117us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044259.003167:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784044259.003469:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044259.003483:0:15575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75512bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75512c6 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.003491:0:15575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75512bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75512c6 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044259.004255:0:15575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784044259.006756:0:15575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044259.007256:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784044259.007304:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784044259.007341:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784044259.008264:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784044259.008318:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784044259.008353:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784044259.008436:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784044259.008445:0:15575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784044259.008632:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044259.008702:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.008756:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd4232840 going to sleep for 11 seconds 00000100:00100000:2.0:1784044259.009328:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598755712 00000100:00100000:2.0:1784044259.009338:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598755712 00000100:00100000:2.0:1784044259.009394:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784044259.009403:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:15575:x1870705598755712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044259.013808:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:15575:x1870705598755712:12345-0@lo:501:mount.lustre.0 Request processed in 4398us (5097us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044259.013822:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784044259.014010:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044259.014072:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044259.014125:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.014177:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd4232840 going to sleep for 11 seconds 00000100:00100000:2.0:1784044259.014598:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598755840 00000100:00100000:2.0:1784044259.014606:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598755840 00000100:00100000:2.0:1784044259.014644:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784044259.014653:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:15575:x1870705598755840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044259.015041:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:15575:x1870705598755840:12345-0@lo:503:mount.lustre.0 Request processed in 387us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044259.015049:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784044259.015317:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755840:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784044259.018146:0:15575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784044259.018273:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044259.018387:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044259.018452:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044259.019112:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598755968 00000100:00100000:0.0:1784044259.019122:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598755968 00000100:00100000:0.0:1784044259.019182:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784044259.019192:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:15575:x1870705598755968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044259.019488:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:15575:x1870705598755968:12345-0@lo:502:mount.lustre.0 Request processed in 297us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044259.019497:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784044259.019663:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598755968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044259.019967:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784044259.020014:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784044259.020043:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784044259.020084:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784044259.020117:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784044259.020149:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784044259.020195:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784044259.020232:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784044259.020280:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1784044259.020317:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044259.020372:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.020402:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd4232d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044259.021428:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598756096 00000100:00100000:0.0:1784044259.021440:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598756096 00000100:00100000:0.0:1784044259.021504:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784044259.021514:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:15575:x1870705598756096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044259.021767:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:15575:x1870705598756096:12345-0@lo:502:mount.lustre.0 Request processed in 253us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044259.021777:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784044259.022282:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044259.022403:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1784044259.022418:0:15575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1784044259.024420:0:15577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784044259.024433:0:15577:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1784044259.024441:0:15577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044259.024443:0:15577:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1784044259.024449:0:15577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784044259.024465:0:15577:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff904bff854d40) 00000020:00000080:0.0:1784044259.024489:0:15577:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784044259.024495:0:15577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784044259.024637:0:15577:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904bcff24000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1784044259.024646:0:15577:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784044259.024661:0:15577:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9cc73983a75512d4 00010000:00010000:0.0:1784044259.033613:0:15577:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1784044259.034055:0:15577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1784044259.035656:0:15577:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1784044259.037263:0:15577:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1784044259.037274:0:15577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044259.037281:0:15577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044259.037283:0:15577:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1784044259.037287:0:15577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044259.037291:0:15577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044259.037293:0:15577:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784044259.037296:0:15577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784044259.037298:0:15577:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784044259.037300:0:15577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044259.037303:0:15577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044259.037304:0:15577:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784044259.037306:0:15577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044259.037309:0:15577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044259.037310:0:15577:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784044259.037314:0:15577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784044259.037369:0:15577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044259.037373:0:15577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044259.037375:0:15577:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784044259.037378:0:15577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1784044259.039418:0:15575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1784044259.039465:0:15575:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784044259.039565:0:15575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75512bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75512c6 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044259.039578:0:15575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bffa9ac00/0x9cc73983a75512bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75512c6 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044259.039598:0:15575:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bcff24000 from 1 10000000:01000000:2.0:1784044259.039601:0:15575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044259.039637:0:15575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044259.039645:0:15575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044259.039655:0:15575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044259.039678:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756224:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044259.039746:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044259.039792:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044259.040655:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598756224 00000100:00100000:0.0:1784044259.040665:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598756224 00000100:00100000:0.0:1784044259.040724:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784044259.040734:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:15575:x1870705598756224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044259.040749:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044259.040765:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee7200/0x9cc73983a75512e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a75512db expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044259.040806:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee7200/0x9cc73983a75512e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a75512db expref: 18 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044259.040816:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee7200/0x9cc73983a75512e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75512db expref: 18 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044259.040825:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7200, rc 0) 00000100:00100000:0.0:1784044259.040908:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598756224:12345-0@lo:101:mount.lustre.0 Request processed in 176us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044259.040915:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784044259.041082:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756224:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044259.041100:0:15575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044259.041108:0:15575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044259.042019:0:15575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1784044259.042345:0:15575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044259.042705:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1784044259.042750:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1784044259.042813:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1784044259.042821:0:15575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1784044259.043450:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044259.044800:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044259.044916:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bf589e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044259.050300:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598756352 00000100:00100000:0.0:1784044259.050314:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598756352 00000100:00100000:0.0:1784044259.050415:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784044259.050427:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598756352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044259.050764:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598756352:12345-0@lo:501:mount.lustre.0 Request processed in 339us (5966us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044259.050772:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784044259.050896:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044259.050947:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044259.050998:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.051344:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd9d48600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044259.051409:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598756480 00000100:00100000:2.0:1784044259.051415:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598756480 00000100:00100000:2.0:1784044259.051446:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784044259.051454:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598756480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044259.051714:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598756480:12345-0@lo:503:mount.lustre.0 Request processed in 260us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044259.051722:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784044259.051886:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756480:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784044259.052406:0:15575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044259.052477:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044259.052542:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.052578:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5954240 going to sleep for 11 seconds 00000100:00100000:2.0:1784044259.052781:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598756608 00000100:00100000:2.0:1784044259.052787:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598756608 00000100:00100000:2.0:1784044259.052815:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784044259.052822:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598756608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044259.053023:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598756608:12345-0@lo:502:mount.lustre.0 Request processed in 199us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044259.053029:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784044259.053243:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044259.053462:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1784044259.053512:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1784044259.053646:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1784044259.053686:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1784044259.053715:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1784044259.053758:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1784044259.053795:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1784044259.053824:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1784044259.054470:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044259.054677:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.054751:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5954240 going to sleep for 11 seconds 00000100:00100000:1.0:1784044259.054815:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598756736 00000100:00100000:1.0:1784044259.054823:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598756736 00000100:00100000:2.0:1784044259.055154:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784044259.055165:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bed95a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598756736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044259.055423:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bed95a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598756736:12345-0@lo:502:mount.lustre.0 Request processed in 260us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044259.055431:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784044259.055584:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044259.055720:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784044259.055736:0:15575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1784044259.057507:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044259.057520:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044259.057522:0:15581:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784044259.057600:0:15581:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904bcff24000 00000020:00000080:3.0:1784044259.057603:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044259.057611:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044259.057614:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044259.057616:0:15581:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784044259.057618:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044259.057621:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044259.057622:0:15581:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784044259.057626:0:15581:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff904bcff24000 00000020:00000080:3.0:1784044259.057628:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044259.057718:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044259.057730:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044259.057732:0:15581:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784044259.057734:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044259.057737:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044259.057738:0:15581:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784044259.057741:0:15581:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff904bcff24000 00000020:00000080:3.0:1784044259.057743:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044259.063168:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044259.063179:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044259.063182:0:15581:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784044259.063185:0:15581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1784044259.064001:0:15575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1784044259.064032:0:15575:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044259.064052:0:15575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.064065:0:15575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044259.064109:0:15575:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784044259.064111:0:15575:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff904bcff24000 10000000:01000000:3.0:1784044259.064114:0:15575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff904bcff24000 10000000:01000000:3.0:1784044259.064118:0:15575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044259.064123:0:15575:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff904bcff24000 from 1 10000000:01000000:3.0:1784044259.064126:0:15575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784044259.064160:0:15575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9bc00/0x9cc73983a75512e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.064167:0:15575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bffa9bc00/0x9cc73983a75512e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.064178:0:15575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bffa9bc00/0x9cc73983a75512e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044259.064211:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044259.064274:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.064310:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc59546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044259.066045:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598756864 00000100:00100000:3.0:1784044259.066058:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598756864 00000100:00100000:3.0:1784044259.066111:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784044259.066119:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598756864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044259.066134:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044259.066149:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9a200/0x9cc73983a75512f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a75512e9 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.066174:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9a200/0x9cc73983a75512f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a75512e9 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.066184:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9a200/0x9cc73983a75512f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75512e9 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.066193:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a200, rc 0) 00000100:00100000:3.0:1784044259.066252:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:15575:x1870705598756864:12345-0@lo:101:mount.lustre.0 Request processed in 134us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044259.066259:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784044259.066308:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044259.066323:0:15575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bffa9bc00/0x9cc73983a75512e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75512f0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.066332:0:15575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bffa9bc00/0x9cc73983a75512e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a75512f0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044259.066965:0:15575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1784044259.067279:0:15575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044259.067594:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784044259.067640:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1784044259.067675:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1784044259.067723:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1784044259.067756:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1784044259.067804:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1784044259.067898:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1784044259.067936:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1784044259.067986:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1784044259.068022:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1784044259.068056:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1784044259.068106:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1784044259.068144:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1784044259.068180:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1784044259.068232:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1784044259.068273:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1784044259.068309:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1784044259.068360:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1784044259.068399:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1784044259.068434:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1784044259.068487:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1784044259.068524:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1784044259.068583:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1784044259.068637:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1784044259.068674:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1784044259.068708:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1784044259.068760:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1784044259.068799:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1784044259.068835:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1784044259.072417:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1784044259.072456:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1784044259.072488:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1784044259.072534:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1784044259.072584:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1784044259.072635:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1784044259.072688:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1784044259.072724:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1784044259.072821:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1784044259.072830:0:15575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1784044259.073305:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044259.073374:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.073470:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc59546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044259.076664:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598756992 00000100:00100000:2.0:1784044259.076679:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598756992 00000100:00100000:3.0:1784044259.080073:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044259.080088:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:15575:x1870705598756992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044259.084025:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:15575:x1870705598756992:12345-0@lo:501:mount.lustre.0 Request processed in 3931us (10642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044259.084039:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784044259.084158:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598756992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044259.084212:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598757120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044259.084269:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044259.084308:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5074c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044259.084677:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598757120 00000100:00100000:3.0:1784044259.084683:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598757120 00000100:00100000:3.0:1784044259.084731:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044259.084741:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:15575:x1870705598757120:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044259.084985:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:15575:x1870705598757120:12345-0@lo:503:mount.lustre.0 Request processed in 245us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044259.084992:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784044259.085088:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598757120:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784044259.088889:0:15575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044259.088991:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598757248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044259.089076:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.089132:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5954cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044259.089196:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598757248 00000100:00100000:2.0:1784044259.089205:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598757248 00000100:00100000:2.0:1784044259.089252:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784044259.089261:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:15575:x1870705598757248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044259.089491:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:15575:x1870705598757248:12345-0@lo:502:mount.lustre.0 Request processed in 229us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044259.089499:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784044259.091095:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598757248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044259.091429:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1784044259.091490:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1784044259.092757:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1784044259.094202:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1784044259.094289:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1784044259.094352:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1784044259.094387:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1784044259.094417:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1784044259.094483:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1784044259.094541:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1784044259.094581:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1784044259.094661:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1784044259.094701:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1784044259.094733:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1784044259.094783:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1784044259.094823:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1784044259.094920:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1784044259.094972:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1784044259.095006:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1784044259.095038:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1784044259.095086:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1784044259.095123:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1784044259.095156:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1784044259.095203:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1784044259.095240:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1784044259.095272:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1784044259.095321:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1784044259.095358:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1784044259.095394:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1784044259.095442:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1784044259.095491:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1784044259.095528:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1784044259.095581:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1784044259.095645:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1784044259.095684:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1784044259.095732:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1784044259.095770:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1784044259.095803:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1784044259.098483:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1784044259.099059:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1784044259.099116:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598757376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044259.099202:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.099247:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5954cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044259.099326:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598757376 00000100:00100000:2.0:1784044259.099334:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598757376 00000100:00100000:2.0:1784044259.099421:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784044259.099432:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:15575:x1870705598757376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044259.099690:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:15575:x1870705598757376:12345-0@lo:502:mount.lustre.0 Request processed in 259us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044259.099698:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784044259.108309:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598757376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044259.108466:0:15575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1784044259.108482:0:15575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1784044259.110702:0:15586:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784044259.110720:0:15586:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff904bed5c4d40) 00000020:00000080:1.0:1784044259.110749:0:15586:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1784044259.110945:0:15586:0:(tgt_mount.c:153:server_get_mount()) get mount ffff904bcff24000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784044259.110956:0:15586:0:(tgt_mount.c:187:server_put_mount()) put mount ffff904bcff24000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784044259.110959:0:15586:0:(obd_mount.c:710:lustre_put_lsi()) put ffff904bcff24000 3 00010000:00080000:1.0:1784044259.110991:0:15586:0:(ldlm_lib.c:102:import_set_conn()) imp ffff904bc635a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.150@tcp at head 00010000:00010000:1.0:1784044259.112754:0:15586:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1784044259.112898:0:15586:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1784044259.112936:0:15586:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784044259.112950:0:15586:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9cc73983a75512fe 00000100:00080000:1.0:1784044259.112960:0:15586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784044259.112965:0:15586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff904bc635a800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1784044259.113001:0:15586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904ac2b9c000 x1870705598757504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044259.113034:0:15586:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784044259.113090:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044259.113094:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784044259.113096:0:37:0:(import.c:65:import_set_state_nolock()) ffff904ac3627000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044259.113101:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:1.0:1784044259.113104:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784044259.113108:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff904ac3627000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1784044259.113120:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904ac2b9c380 x1870705598757760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044259.113168:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598757632:0@lo:400:kworker.0 00000100:00100000:1.0:1784044259.113236:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044259.113273:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044259.113278:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598757888:0@lo:400:kworker.0 00000100:00100000:1.0:1784044259.113305:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044259.113332:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598758016:0@lo:400:kworker.0 00000100:00100000:1.0:1784044259.113373:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044259.113407:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598757632 00000100:00100000:1.0:1784044259.113414:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598757632 00000100:00100000:1.0:1784044259.113464:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044259.113473:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598757632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044259.113536:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598757632:12345-0@lo:400:kworker.0 Request processed in 64us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044259.113544:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044259.113567:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598757888 00000100:00100000:1.0:1784044259.113570:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598757888 00000100:00100000:1.0:1784044259.113592:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598758016 00000100:00100000:1.0:1784044259.113595:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598758016 00000100:00100000:1.0:1784044259.113611:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044259.113617:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598757888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044259.113649:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598757888:12345-0@lo:400:kworker.0 Request processed in 31us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044259.113656:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044259.113666:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784044259.113672:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598758016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044259.113703:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1870705598758016:12345-0@lo:400:kworker.0 Request processed in 31us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044259.113708:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1784044259.113725:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044259.113730:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044259.114198:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1870705598757504:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784044259.114243:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.114274:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598757760:0@lo:8:kworker.0 00000100:00100000:3.0:1784044259.114296:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.114329:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598757504 00000100:00100000:3.0:1784044259.114333:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598757504 00000100:00100000:3.0:1784044259.114355:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044259.114360:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3287:x1870705598757504:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784044259.114381:0:14274:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:3.0:1784044259.114414:0:14274:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9cc73983a7551305 00000004:00100000:3.0:1784044259.114428:0:14274:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784044259.114455:0:14274:0:(import.c:65:import_set_state_nolock()) ffff904bc2f7c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044259.114505:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870705598757504:12345-0@lo:38:llog_process_th.0 Request processed in 143us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044259.114512:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784044259.114542:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904ac2b9c000 x1870705598757504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044259.114552:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784044259.114559:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1784044259.114566:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784044259.114570:0:3287:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784044259.114572:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904bc635a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784044259.114578:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1870705598757504:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784044259.121285:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904ac2b9e680 x1870705598757888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044259.121309:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598757888:0@lo:400:kworker.0 00000100:00100000:1.0:1784044259.121357:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598757632:0@lo:400:kworker.0 00010000:00080000:1.0:1784044259.121419:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff904ac2b9ca80 x1870705598758016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044259.121429:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1870705598758016:0@lo:400:kworker.0 00000100:00100000:1.0:1784044259.121454:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598757760 00000100:00100000:1.0:1784044259.121460:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598757760 00000100:00100000:1.0:1784044259.121506:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784044259.121513:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1870705598757760:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1784044259.121606:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1870705598757760:12345-0@lo:8:kworker.0 Request processed in 91us (7307us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784044259.121614:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784044259.121643:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784044259.121650:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904ac3627000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044259.121654:0:3287:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784044259.121658:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598757760:0@lo:8:kworker.0 00000040:00080000:1.0:1784044259.121963:0:15586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1784044259.123181:0:15575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1784044259.123223:0:15575:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784044259.123244:0:15575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9bc00/0x9cc73983a75512e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75512f0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044259.123255:0:15575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bffa9bc00/0x9cc73983a75512e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a75512f0 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784044259.123308:0:15575:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784044259.123310:0:15575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784044259.123312:0:15575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044259.123313:0:15575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044259.123314:0:15575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044259.123316:0:15575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044259.123317:0:15575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784044259.123319:0:15575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044259.123320:0:15575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784044259.123324:0:15575:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1784044259.123327:0:15575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784044259.123332:0:15575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784044259.123333:0:15575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044259.123334:0:15575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044259.123335:0:15575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044259.123336:0:15575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044259.123337:0:15575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784044259.123339:0:15575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044259.123339:0:15575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784044259.123367:0:15575:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784044259.123387:0:15575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598758144:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784044259.123452:0:15575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044259.123490:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598758144 00000100:00100000:3.0:1784044259.123496:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598758144 00000100:00100000:3.0:1784044259.123536:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784044259.123544:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:15575:x1870705598758144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784044259.123581:0:14267:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784044259.123595:0:14267:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784044259.124412:0:15575:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5954840 going to sleep for 11 seconds 20000000:01000000:2.0:1784044259.146812:0:14267:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784044259.146848:0:14267:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784044259.147379:0:14289:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784044259.147385:0:14289:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784044259.147407:0:14289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.147425:0:14289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904beb0fc800/0x9cc73983a75511e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75511df expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.147433:0:14289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.147490:0:14289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904beb0fc800/0x9cc73983a75511e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a75511df expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.147505:0:14289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904beb0fc800/0x9cc73983a75511e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a75511df expref: 19 pid: 14266 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044259.147520:0:14289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14289:1870705598758272:0@lo:104: 00000100:00100000:1.0:1784044259.147583:0:14289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044259.147622:0:14289:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb3be780 going to sleep for 11 seconds 00000100:00100000:0.0:1784044259.147710:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598758272 00000100:00100000:0.0:1784044259.147717:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598758272 00000100:00100000:0.0:1784044259.147761:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044259.147770:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+3:14289:x1870705598758272:12345-0@lo:104: 00010000:00010000:0.0:1784044259.147783:0:14257:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044259.147833:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784044259.147838:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+3:14289:x1870705598758272:12345-0@lo:104: Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044259.147896:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1784044259.147931:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044259.147937:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044259.147946:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6200 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:0.0:1784044259.147950:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044259.147958:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044259.147965:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044259.147971:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784044259.147997:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044259.148004:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044259.148025:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044259.148032:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904beeee6200/0x9cc73983a75511df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75511e6 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044259.148048:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044259.148050:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044259.148052:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044259.148064:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d72db5ce-ca39-4323-bf26-8b60fe27b493:3291:1870705598758400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044259.148098:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044259.148303:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598758400 00000100:00100000:1.0:1784044259.148308:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598758400 00010000:00010000:1.0:1784044259.148331:0:14260:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904beb0fc800/0x9cc73983a75511e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75511df expref: 20 pid: 14266 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044259.148350:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044259.148357:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72db5ce-ca39-4323-bf26-8b60fe27b493+20:3291:x1870705598758400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044259.148368:0:14260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044259.148372:0:14260:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904beb0fc800/0x9cc73983a75511e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75511df expref: 20 pid: 14266 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148382:0:14260:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904beb0fc800/0x9cc73983a75511e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a75511df expref: 20 pid: 14266 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148399:0:14260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148406:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784044259.148429:0:14260:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001887127s 00010000:00010000:1.0:1784044259.148433:0:14260:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148440:0:14260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148447:0:14260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148454:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148459:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044259.148463:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148470:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148479:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148488:0:14260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044259.148530:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72db5ce-ca39-4323-bf26-8b60fe27b493+20:3291:x1870705598758400:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044259.148537:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1784044259.148602:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beb0fc800/0x9cc73983a75511e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a75511df expref: 19 pid: 14266 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044259.148623:0:14289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14289:1870705598758272:0@lo:104: 00010000:00010000:1.0:1784044259.148639:0:14289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148648:0:14289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148653:0:14289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044259.148659:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1662600/0x9cc73983a755130c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044259.150768:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d72db5ce-ca39-4323-bf26-8b60fe27b493:3291:1870705598758400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044259.160110:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:15575:x1870705598758144:12345-0@lo:253:mount.lustre.0 Request processed in 36557us (36648us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044259.160126:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784044259.160243:0:15575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d72db5ce-ca39-4323-bf26-8b60fe27b493:15575:1870705598758144:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784044259.160257:0:15575:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784044259.160260:0:15575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784044259.160262:0:15575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784044259.160264:0:15575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044259.160265:0:15575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044259.160266:0:15575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044259.160267:0:15575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044259.160269:0:15575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784044259.160271:0:15575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044259.160273:0:15575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784044259.160292:0:15575:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784044259.167071:0:15575:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784044259.167245:0:15575:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784044259.167400:0:15575:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784044259.167553:0:15575:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784044259.167782:0:15575:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784044259.168322:0:15575:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784044259.169254:0:15575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1784044259.214696:0:15575:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1784044259.214705:0:15575:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1784044259.214737:0:15575:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784044259.214799:0:15575:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784044259.214827:0:15575:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1784044259.214882:0:15575:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1784044259.550465:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784044260.254346:0:14269:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784044260.254356:0:14269:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff904bc7f70800 from 8 10000000:01000000:1.0:1784044260.254363:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784044260.254431:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7551313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044260.254446:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7551313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044260.254459:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7551313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044260.254494:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598758528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044260.254591:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044260.254781:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598758528 00000100:00100000:3.0:1784044260.254796:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598758528 00000100:00100000:3.0:1784044260.254948:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784044260.254960:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:14269:x1870705598758528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044260.254976:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044260.254995:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9be00/0x9cc73983a755131a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7551313 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044260.255020:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9be00/0x9cc73983a755131a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7551313 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044260.255031:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9be00/0x9cc73983a755131a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7551313 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044260.255041:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9be00, rc 0) 00000100:00100000:3.0:1784044260.255115:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:14269:x1870705598758528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044260.255128:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784044260.256010:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb3bec00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044260.256056:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598758528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044260.256099:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7551313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755131a expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044260.256115:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7551313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a755131a expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044260.256189:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904ac2b9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598758656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784044260.256254:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044260.256280:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bfb3bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044260.256806:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598758656 00000100:00100000:2.0:1784044260.256831:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598758656 00000100:00100000:2.0:1784044260.256966:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784044260.256976:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:14269:x1870705598758656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784044260.257002:0:14267:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784044260.257022:0:14267:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784044260.257025:0:14267:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1784044260.257129:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:14269:x1870705598758656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044260.257137:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784044260.257191:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904ac2b9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598758656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784044260.257262:0:14269:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784044260.257272:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7551313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755131a expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044260.257283:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1662600/0x9cc73983a7551313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a755131a expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044260.577693:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784044261.365240:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1784044261.365282:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1784044261.600896:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044262.622066:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044263.326059:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598758784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044263.326132:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044263.326268:0:14913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598758784 00000100:00100000:3.0:1784044263.326276:0:14913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598758784 00000100:00100000:3.0:1784044263.326327:0:14913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044263.326337:0:14913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598758784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044263.326373:0:14913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044263.326417:0:14913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598758784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044263.326432:0:14913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044263.326498:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1784044263.326522:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598758784:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784044263.326585:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784044263.650249:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044264.096110:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1784044264.354920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044264.354927:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044264.354930:0:8:0:(import.c:65:import_set_state_nolock()) ffff904ac3627000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044264.354944:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff904ac3627000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1784044264.354967:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff904bf5ba0380 x1870705598759168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044264.355138:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598758912:0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.355205:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044264.355253:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598759552:0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.355285:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044264.355313:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044264.355319:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598759424:0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.355341:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044264.355371:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598759040:0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.355397:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044264.355416:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044264.355421:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598759296:0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.355442:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044264.355468:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598759168:0@lo:8:kworker.0 00000100:00100000:0.0:1784044264.355491:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044264.355541:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598758912 00000100:00100000:0.0:1784044264.355548:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598758912 00000100:00100000:0.0:1784044264.355596:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784044264.356722:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf599e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3289:x1870705598758912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.356810:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf599e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3289:x1870705598758912:12345-0@lo:400:kworker.0 Request processed in 1206us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044264.356820:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784044264.356879:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598759552 00000100:00100000:0.0:1784044264.356885:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598759552 00000100:00100000:0.0:1784044264.356919:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598759424 00000100:00100000:0.0:1784044264.356922:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598759424 00000100:00100000:0.0:1784044264.356932:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598759296 00000100:00100000:0.0:1784044264.356934:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598759296 00000100:00100000:0.0:1784044264.356945:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044264.356951:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598759552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.356981:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598759552:12345-0@lo:400:kworker.0 Request processed in 30us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044264.356987:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044264.356997:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784044264.357002:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598759424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.357023:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598759424:12345-0@lo:400:kworker.0 Request processed in 21us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044264.357028:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784044264.357037:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784044264.357042:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598759296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.357066:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598759296:12345-0@lo:400:kworker.0 Request processed in 24us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044264.357072:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784044264.357095:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598759040 00000100:00100000:0.0:1784044264.357104:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598759040 00000100:00100000:0.0:1784044264.357124:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598759168 00000100:00100000:0.0:1784044264.357126:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598759168 00000100:00100000:0.0:1784044264.357136:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044264.357141:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598759040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.357170:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598759040:12345-0@lo:400:kworker.0 Request processed in 29us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044264.357176:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044264.357185:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044264.357189:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3287:x1870705598759168:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784044264.357212:0:14910:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1784044264.357238:0:14910:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9cc73983a7551321 00002000:00100000:0.0:1784044264.357251:0:14910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff904bc5cbd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784044264.357255:0:14910:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784044264.357259:0:14910:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784044264.357565:0:14910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784044264.357588:0:14910:0:(import.c:65:import_set_state_nolock()) ffff904bc5cbd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044264.358376:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1870705598759168:12345-0@lo:8:kworker.0 Request processed in 1181us (2880us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044264.358387:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784044264.359531:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5ba1f80 x1870705598759424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044264.359550:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598759424:0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.359563:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598758912:0@lo:400:kworker.0 00010000:00080000:0.0:1784044264.359575:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5ba0000 x1870705598759552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044264.359593:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598759552:0@lo:400:kworker.0 00000100:00080000:0.0:1784044264.360377:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784044264.360711:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5ba3480 x1870705598759296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044264.360887:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598759296:0@lo:400:kworker.0 00000100:00100000:0.0:1784044264.360905:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598759040:0@lo:400:kworker.0 00010000:00080000:0.0:1784044264.361001:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bf5ba0380 x1870705598759168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784044264.361016:0:3287:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784044264.361024:0:3287:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784044264.361031:0:3287:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784044264.361035:0:3287:0:(import.c:65:import_set_state_nolock()) ffff904ac3627000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784044264.361052:0:3287:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784044264.361059:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1870705598759168:0@lo:8:kworker.0 00000004:00080000:0.0:1784044264.361153:0:14298:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1784044264.361177:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14298:1870705598759808:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784044264.361233:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044264.361261:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd4232540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044264.364073:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044264.364106:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598759680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044264.364177:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044264.364214:0:14913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598759680 00000100:00100000:3.0:1784044264.364224:0:14913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598759680 00000100:00080000:1.0:1784044264.364261:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044264.364293:0:14913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044264.364299:0:14912:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1784044264.364306:0:14913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1870705598759680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044264.364311:0:14912:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1784044264.364344:0:14913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044264.364404:0:14913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1870705598759680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044264.364411:0:14913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784044264.364525:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff904bc5aded80 x1870705598759680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044264.364546:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598759680:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1784044264.366049:0:14297:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1784044264.366943:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598759808 00000100:00100000:1.0:1784044264.366955:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598759808 00000100:00100000:1.0:1784044264.367022:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044264.367034:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14298:x1870705598759808:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784044264.367061:0:14297:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 442352194368ns, next at 0ns, rc = 0 00002000:00080000:1.0:1784044264.371175:0:14910:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1784044264.371186:0:14910:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1784044264.371192:0:14910:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1784044264.380920:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.380933:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551328 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.380953:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.380958:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.380965:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551328 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.380984:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551328 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.380996:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551328 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381005:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551328 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381024:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044264.381037:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.381044:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551328 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381064:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.381069:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551328 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381079:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551328 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381097:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551328 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381105:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551328 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381124:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.381127:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.381130:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.381646:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.381654:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a755132f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381663:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.381667:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.381671:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a755132f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381681:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a755132f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381696:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a755132f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381703:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a755132f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.381725:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044264.381734:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044264.381753:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a755132f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.381763:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662400 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044264.381767:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a755132f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.381777:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a755132f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.381794:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a755132f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.381802:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a755132f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.381836:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.381839:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.381842:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.382394:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.382401:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a7551336 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.382410:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.382414:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.382418:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a7551336 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.382428:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a7551336 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.382436:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a7551336 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.382443:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a7551336 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.382468:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044264.382477:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.382482:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a7551336 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.382489:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.382493:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a7551336 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.382501:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a7551336 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.382512:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a7551336 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.382519:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a7551336 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.382534:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.382536:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.382537:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.383067:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.383074:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002629004e/0x9cc73983a755133d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.383083:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.383091:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.383096:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002629004e/0x9cc73983a755133d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.383106:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002629004e/0x9cc73983a755133d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.383115:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002629004e/0x9cc73983a755133d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.383123:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002629004e/0x9cc73983a755133d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.383693:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044264.384198:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.384205:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551344 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.384217:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.384222:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.384226:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551344 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.384239:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551344 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.384248:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551344 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.384263:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551344 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.390989:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044264.391004:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002629004e/0x9cc73983a755133d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.391035:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044264.391040:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002629004e/0x9cc73983a755133d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.391051:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002629004e/0x9cc73983a755133d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.391078:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002629004e/0x9cc73983a755133d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.391087:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002629004e/0x9cc73983a755133d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.391110:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044264.391115:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551344 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.391121:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044264.391125:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551344 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.391132:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551344 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.391143:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551344 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.391159:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.391161:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.391163:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.392045:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784044264.392056:0:14910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551344 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.392094:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.392728:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.392737:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a755134b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.392766:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.392772:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.392779:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a755134b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.392794:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a755134b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.392806:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a755134b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.392815:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a755134b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.392848:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044264.393157:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044264.393164:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a755134b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.393173:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663800 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044264.393178:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a755134b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.393188:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a755134b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.393284:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a755134b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.393293:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e4cff9/0x9cc73983a755134b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.393313:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.393315:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.393318:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044264.393318:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.393326:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7551352 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.393335:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.393338:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.393342:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7551352 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.393351:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7551352 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.393359:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7551352 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.393367:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7551352 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.393382:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044264.393391:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.393396:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7551352 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.393404:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.393414:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7551352 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.393423:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7551352 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.393435:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7551352 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.393444:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a7551352 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.393460:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.393462:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.393465:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.394040:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.394048:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551359 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394059:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.394064:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.394069:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551359 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394080:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551359 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394090:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551359 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394103:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551359 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394119:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044264.394129:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.394133:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551359 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394140:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.394144:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551359 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394153:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551359 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394165:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551359 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394172:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a7551359 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394184:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.394186:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.394188:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.394652:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.394667:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551360 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394676:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.394680:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.394684:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551360 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394695:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551360 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394703:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551360 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394711:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394725:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044264.394734:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.394752:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394760:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.394764:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394772:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394792:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551360 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394800:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551360 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.394814:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.394816:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.394818:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.399267:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.399281:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551367 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.399299:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.399304:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.399310:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551367 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.399325:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551367 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.399337:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551367 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.399346:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551367 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.399375:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044264.399387:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.399393:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551367 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.399402:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.399406:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551367 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.399415:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551367 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.399432:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551367 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.399440:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551367 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.399456:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.399458:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.399459:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.401442:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.401458:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755136e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.401473:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.401484:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.401491:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755136e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.401508:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755136e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.401520:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755136e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.401529:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755136e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.401547:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044264.401561:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.401567:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755136e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.401575:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.401580:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755136e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.401589:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755136e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.401604:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755136e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.401623:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755136e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.401642:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.401644:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.401646:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.402150:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.402157:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551375 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402167:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.402170:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.402175:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551375 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402186:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551375 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402195:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551375 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402202:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551375 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402218:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044264.402227:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.402238:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551375 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402244:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662400 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.402248:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551375 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402255:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551375 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402265:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551375 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402273:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551375 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402288:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.402290:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.402292:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.402727:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.402754:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a755137c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402762:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.402766:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.402770:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a755137c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402789:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a755137c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402799:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a755137c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402806:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a755137c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402822:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044264.402834:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.402838:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a755137c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402846:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.402849:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a755137c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.402857:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a755137c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.403315:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a755137c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.403324:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a755137c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.403347:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.403349:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.403351:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.407181:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.407196:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551383 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.407215:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.407220:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.407228:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.407243:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.407254:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.407264:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551383 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.407293:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044264.407798:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.407806:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755138a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.407819:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.407830:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1784044264.407831:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551383 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.407836:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.407844:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755138a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.407848:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662400 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044264.407855:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551383 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.407859:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755138a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.407895:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755138a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.407902:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755138a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.407916:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044264.408248:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1784044264.408343:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.408350:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551391 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.408364:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.408364:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.408369:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.408379:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.408392:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.408393:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551383 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.408415:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.408423:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.408432:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044264.408781:0:15895:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044264.408791:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755138a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.408810:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044264.408818:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755138a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.408820:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e14fd768/0x9cc73983a7551383 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.408841:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755138a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.408856:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755138a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.408890:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0efd1fb/0x9cc73983a755138a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.408906:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.408908:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.408910:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.408944:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.408951:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551398 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.408961:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.408965:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.408969:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551398 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.408980:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551398 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.408989:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551398 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.408998:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551398 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.409024:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044264.409413:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.409419:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a755139f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.409428:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.409431:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.409435:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a755139f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.409445:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a755139f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.409453:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a755139f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.409460:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a755139f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.409468:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784044264.410614:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044264.410624:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551398 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.410635:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044264.410680:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551398 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.410690:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551398 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.410717:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551398 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.410725:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020284f79/0x9cc73983a7551398 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.410757:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044264.410762:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a755139f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.410769:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044264.410773:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a755139f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.410781:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a755139f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.410792:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a755139f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.410799:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007362186b/0x9cc73983a755139f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.410810:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.410812:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.410819:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.413560:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.413566:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.413568:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.413629:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.413631:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.413632:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.413648:0:15895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.413664:0:15895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:3.0:1784044264.413669:0:15895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.413679:0:15895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.413699:0:15895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551391 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.413706:0:15895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e26cff1d/0x9cc73983a7551391 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044264.413738:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.413747:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044264.413749:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.414378:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.414388:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a75513a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.414401:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.414412:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.414419:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a75513a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.414434:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a75513a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.414445:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a75513a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.414453:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a75513a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.414468:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044264.415605:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044264.415615:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a75513a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.415627:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044264.415633:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a75513a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.415642:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a75513a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.415658:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a75513a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.415666:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073c5eb7d/0x9cc73983a75513a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.415688:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.415690:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.415692:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.415857:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.415880:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.415891:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.415896:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.415901:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.415913:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.415922:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.415937:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.415955:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044264.415968:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.415973:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.415982:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.415986:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.415995:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.416009:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.416017:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.416032:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.416035:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.416037:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044264.418525:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044264.418544:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6534a8b/0x9cc73983a75513b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.418563:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1784044264.418569:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044264.418576:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6534a8b/0x9cc73983a75513b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.418600:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6534a8b/0x9cc73983a75513b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.418611:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6534a8b/0x9cc73983a75513b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.418620:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6534a8b/0x9cc73983a75513b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.418651:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784044264.419145:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044264.419152:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bacd9683/0x9cc73983a75513bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.419161:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1784044264.419165:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044264.419169:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bacd9683/0x9cc73983a75513bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.419179:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bacd9683/0x9cc73983a75513bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.419186:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bacd9683/0x9cc73983a75513bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.419215:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bacd9683/0x9cc73983a75513bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.419234:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784044264.419366:0:15896:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044264.419376:0:15896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6534a8b/0x9cc73983a75513b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.419393:0:15896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.419399:0:15896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6534a8b/0x9cc73983a75513b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.419409:0:15896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6534a8b/0x9cc73983a75513b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.419427:0:15896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6534a8b/0x9cc73983a75513b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.419435:0:15896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6534a8b/0x9cc73983a75513b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.419455:0:15896:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.419459:0:15896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bacd9683/0x9cc73983a75513bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.419465:0:15896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7800 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.419468:0:15896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bacd9683/0x9cc73983a75513bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.419475:0:15896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bacd9683/0x9cc73983a75513bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.419485:0:15896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bacd9683/0x9cc73983a75513bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.419499:0:15896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bacd9683/0x9cc73983a75513bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.419516:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.419519:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.419521:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044264.419648:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044264.419654:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5023431/0x9cc73983a75513c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.419663:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1784044264.419667:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044264.419671:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5023431/0x9cc73983a75513c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.419681:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5023431/0x9cc73983a75513c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.419689:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5023431/0x9cc73983a75513c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.419696:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5023431/0x9cc73983a75513c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.419722:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784044264.420157:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044264.420164:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095cdab3b/0x9cc73983a75513c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.420179:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1784044264.420182:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044264.420186:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095cdab3b/0x9cc73983a75513c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.420196:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095cdab3b/0x9cc73983a75513c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.420203:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095cdab3b/0x9cc73983a75513c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.420209:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095cdab3b/0x9cc73983a75513c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.420222:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784044264.420625:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784044264.420631:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da71bb6b/0x9cc73983a75513d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.420640:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1784044264.420643:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044264.420647:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da71bb6b/0x9cc73983a75513d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.420655:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da71bb6b/0x9cc73983a75513d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.420674:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da71bb6b/0x9cc73983a75513d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.420680:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da71bb6b/0x9cc73983a75513d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.420692:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784044264.422890:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784044264.422909:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5023431/0x9cc73983a75513c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.422925:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.422930:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5023431/0x9cc73983a75513c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.422942:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5023431/0x9cc73983a75513c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.422962:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5023431/0x9cc73983a75513c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.422970:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5023431/0x9cc73983a75513c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.422992:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044264.422996:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095cdab3b/0x9cc73983a75513c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.423012:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.423016:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095cdab3b/0x9cc73983a75513c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.423023:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095cdab3b/0x9cc73983a75513c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.423034:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095cdab3b/0x9cc73983a75513c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.423042:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095cdab3b/0x9cc73983a75513c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.423056:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044264.423060:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da71bb6b/0x9cc73983a75513d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.423067:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6000 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044264.423071:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da71bb6b/0x9cc73983a75513d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.423078:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da71bb6b/0x9cc73983a75513d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.423087:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da71bb6b/0x9cc73983a75513d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.423098:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da71bb6b/0x9cc73983a75513d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.423113:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.423114:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.423116:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.423284:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044264.423290:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784044264.424326:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1784044264.427429:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.427444:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bb9435c/0x9cc73983a75513d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.427463:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.427468:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.427475:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bb9435c/0x9cc73983a75513d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.427488:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bb9435c/0x9cc73983a75513d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.427499:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bb9435c/0x9cc73983a75513d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.427506:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bb9435c/0x9cc73983a75513d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.427544:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044264.427567:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044264.427576:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bb9435c/0x9cc73983a75513d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.427588:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663a00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044264.427593:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bb9435c/0x9cc73983a75513d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.427603:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bb9435c/0x9cc73983a75513d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.427625:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bb9435c/0x9cc73983a75513d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.427632:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bb9435c/0x9cc73983a75513d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.427654:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.427664:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.427666:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.428018:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.428023:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.428032:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.428035:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.428040:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.428048:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.428056:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.428063:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.428087:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044264.428108:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044264.428114:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.428134:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663e00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044264.428139:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.428147:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.428160:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.428168:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d81a9772/0x9cc73983a75513de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.428311:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.428313:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.428315:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044264.428479:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784044264.428485:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ee56bd6/0x9cc73983a75513e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.428493:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1784044264.428500:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044264.428504:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ee56bd6/0x9cc73983a75513e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.428514:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ee56bd6/0x9cc73983a75513e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.428522:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ee56bd6/0x9cc73983a75513e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.428529:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ee56bd6/0x9cc73983a75513e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044264.428552:0:14910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044264.428579:0:15896:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044264.428585:0:15896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ee56bd6/0x9cc73983a75513e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.428593:0:15896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:0.0:1784044264.428597:0:15896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ee56bd6/0x9cc73983a75513e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.428612:0:15896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ee56bd6/0x9cc73983a75513e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.428625:0:15896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ee56bd6/0x9cc73983a75513e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.428633:0:15896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ee56bd6/0x9cc73983a75513e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044264.428649:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.428651:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.428653:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784044264.428720:0:14910:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1784044264.428830:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14298:x1870705598759808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 61795us (67594us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044264.428839:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044264.428895:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14298:1870705598759808:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784044264.428966:0:14298:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1784044264.429017:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14298:1870705598759936:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784044264.429273:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044264.429316:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd4232540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044264.430558:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598759936 00000100:00100000:1.0:1784044264.430571:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598759936 00000100:00100000:1.0:1784044264.430632:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044264.430642:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14298:x1870705598759936:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784044264.430692:0:14911:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1784044264.431594:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044264.440657:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14298:x1870705598759936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10009us (11376us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1784044264.440673:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044264.440794:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14298:1870705598759936:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784044264.440821:0:14298:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1784044264.674941:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784044264.712795:0:15935:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784044265.696440:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044266.719553:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044266.744621:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044266.744686:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583038592 00000100:00100000:2.0:1784044266.744705:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583038592 00000100:00100000:2.0:1784044266.744756:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:2.0:1784044266.744782:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2344:x1870705583038592:12345-192.168.204.50@tcp:250:mount.lustre.0 00010000:00080000:2.0:1784044266.744816:0:14265:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 1af28ca4-f7e6-4d46-a470-327c29aa2a2b@192.168.204.50@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:2.0:1784044266.744852:0:14265:0:(genops.c:1406:class_connect()) connect: client 1af28ca4-f7e6-4d46-a470-327c29aa2a2b, cookie 0x9cc73983a75513ec 00000100:00080000:2.0:1784044266.745037:0:14265:0:(import.c:65:import_set_state_nolock()) ffff904bff476000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044266.745124:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+5:2344:x1870705583038592:12345-192.168.204.50@tcp:250:mount.lustre.0 Request processed in 341us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044266.745132:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:2.0:1784044266.749787:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044266.750005:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583038720 00000100:00100000:0.0:1784044266.750017:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583038720 00000100:00100000:0.0:1784044266.750126:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:0.0:1784044266.750137:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+5:13706:x1870705583038720:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784044266.750170:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044266.750198:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee6000/0x9cc73983a75513f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eada1b expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044266.750239:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee6000/0x9cc73983a75513f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada1b expref: 6 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044266.750250:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee6000/0x9cc73983a75513f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada1b expref: 6 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044266.750259:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6000, rc 0) 00000100:00100000:0.0:1784044266.750317:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+6:13706:x1870705583038720:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 182us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044266.750324:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:0.0:1784044266.756619:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044266.758317:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583038848 00000100:00100000:2.0:1784044266.758331:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583038848 00000100:00100000:2.0:1784044266.758408:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:2.0:1784044266.758420:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+6:13706:x1870705583038848:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784044266.758941:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+6:13706:x1870705583038848:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 522us (2331us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784044266.758950:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:1.0:1784044266.762820:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044266.763238:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583038976 00000100:00100000:0.0:1784044266.763250:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583038976 00000100:00100000:1.0:1784044266.763390:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:1.0:1784044266.763400:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+6:13706:x1870705583038976:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784044266.763417:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044266.763437:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1662800/0x9cc73983a75513fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eada22 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044266.763463:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1662800/0x9cc73983a75513fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada22 expref: 7 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044266.763719:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1662800/0x9cc73983a75513fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada22 expref: 7 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044266.763728:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662800, rc 0) 00000100:00100000:1.0:1784044266.763934:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+7:13706:x1870705583038976:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 535us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044266.764016:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:3.0:1784044266.771705:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044266.771813:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583039104 00000100:00100000:2.0:1784044266.771824:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583039104 00000100:00100000:2.0:1784044266.771918:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:2.0:1784044266.771930:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+7:13706:x1870705583039104:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784044266.772249:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+8:13706:x1870705583039104:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 321us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044266.772258:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:0.0:1784044266.782394:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044266.782489:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583039232 00000100:00100000:1.0:1784044266.782499:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583039232 00000100:00100000:1.0:1784044266.782555:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:1.0:1784044266.782565:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+8:13706:x1870705583039232:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784044266.782926:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+8:13706:x1870705583039232:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 361us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044266.782935:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:1.0:1784044266.793852:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044266.794420:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583039360 00000100:00100000:2.0:1784044266.794431:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583039360 00000100:00100000:2.0:1784044266.794499:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:2.0:1784044266.794522:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+8:13724:x1870705583039360:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044266.794951:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+8:13724:x1870705583039360:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 422us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044266.794960:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:3.0:1784044266.815000:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044266.815619:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583039488 00000100:00100000:1.0:1784044266.815631:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583039488 00000100:00100000:1.0:1784044266.815715:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:1.0:1784044266.815726:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+8:13724:x1870705583039488:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044266.816354:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+8:13724:x1870705583039488:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 627us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044266.816365:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:0.0:1784044266.823618:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044266.823748:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583039616 00000100:00100000:3.0:1784044266.823759:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583039616 00000100:00100000:3.0:1784044266.823813:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:3.0:1784044266.823826:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+8:13706:x1870705583039616:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784044266.823861:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044266.823920:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9a000/0x9cc73983a7551401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eada4c expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044266.823951:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9a000/0x9cc73983a7551401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada4c expref: 9 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044266.823963:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9a000/0x9cc73983a7551401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada4c expref: 9 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044266.823977:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9a000, rc 0) 00000100:00100000:3.0:1784044266.824043:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+9:13706:x1870705583039616:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 219us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044266.824052:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:0.0:1784044266.828561:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044266.828650:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583039744 00000100:00100000:2.0:1784044266.828661:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583039744 00000100:00100000:2.0:1784044266.828745:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:2.0:1784044266.828756:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+9:13706:x1870705583039744:12345-192.168.204.50@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784044266.828782:0:14265:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784044266.828806:0:14265:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784044266.828810:0:14265:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784044266.828814:0:14265:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784044266.828816:0:14265:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1784044266.831597:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+9:13706:x1870705583039744:12345-192.168.204.50@tcp:256:mount.lustre.0 Request processed in 2828us (3031us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044266.831613:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:0.0:1784044266.834773:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044266.835122:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583039872 00000100:00100000:3.0:1784044266.835133:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583039872 00000100:00100000:3.0:1784044266.835227:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:3.0:1784044266.835239:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+9:13706:x1870705583039872:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784044266.835256:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044266.835274:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eada53 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044266.835303:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada53 expref: 10 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044266.835315:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada53 expref: 10 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044266.835343:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b400, rc 0) 00000100:00100000:3.0:1784044266.835452:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+10:13706:x1870705583039872:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 215us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044266.835459:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:1.0:1784044266.837636:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044266.837817:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583040000 00000100:00100000:0.0:1784044266.837826:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583040000 00000100:00100000:1.0:1784044266.837896:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:1.0:1784044266.837908:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+10:13706:x1870705583040000:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784044266.838211:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+10:13706:x1870705583040000:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 303us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044266.838220:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:2.0:1784044266.840039:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044266.840098:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583040128 00000100:00100000:3.0:1784044266.840108:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583040128 00000100:00100000:3.0:1784044266.840353:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:3.0:1784044266.840365:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+10:13706:x1870705583040128:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784044266.840671:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+10:13706:x1870705583040128:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 307us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044266.840679:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:0.0:1784044266.848979:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044266.849049:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583040256 00000100:00100000:2.0:1784044266.849059:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583040256 00000100:00100000:2.0:1784044266.849154:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:2.0:1784044266.849165:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+10:13726:x1870705583040256:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044266.849475:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+10:13726:x1870705583040256:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 311us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044266.849484:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:1.0:1784044266.853299:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044266.856095:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583040384 00000100:00100000:3.0:1784044266.856109:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583040384 00000100:00100000:3.0:1784044266.856459:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:3.0:1784044266.856471:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd02c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+10:13726:x1870705583040384:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784044266.857464:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd02c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+10:13726:x1870705583040384:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 989us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044266.857475:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:3.0:1784044266.865666:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044266.866180:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583040512 00000100:00100000:0.0:1784044266.866204:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583040512 00000100:00100000:0.0:1784044266.866259:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:0.0:1784044266.866268:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2344:x1870705583040512:12345-192.168.204.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784044266.866299:0:14274:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from a2688e73-1cb4-4d8a-8c75-d614a6f1c88e@192.168.204.50@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1784044266.866348:0:14274:0:(genops.c:1406:class_connect()) connect: client a2688e73-1cb4-4d8a-8c75-d614a6f1c88e, cookie 0x9cc73983a755140f 00000004:00100000:0.0:1784044266.866379:0:14274:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1784044266.866386:0:14274:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1784044266.897671:0:14274:0:(import.c:65:import_set_state_nolock()) ffff904bff99f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044266.897784:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:2344:x1870705583040512:12345-192.168.204.50@tcp:38:mount.lustre.0 Request processed in 31513us (32128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044266.897796:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:0.0:1784044266.900497:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044266.900588:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044266.901031:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583040768 00000100:00100000:1.0:1784044266.901042:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583040768 00000100:00080000:1.0:1784044266.901213:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044266.901247:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583040640 00000100:00100000:2.0:1784044266.901252:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583040640 00000100:00100000:0.0:1784044266.901336:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1784044266.901348:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:13706:x1870705583040768:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044266.901392:0:14274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784044266.901518:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:13706:x1870705583040768:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 172us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044266.901525:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1784044266.901558:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1784044266.901565:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:0:x1870705583040640:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044266.901577:0:14274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784044266.901599:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:0:x1870705583040640:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 34us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044266.901604:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1784044266.903878:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044266.903958:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583040896 00000100:00100000:1.0:1784044266.903968:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583040896 00000100:00100000:1.0:1784044266.904021:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1784044266.904031:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:13706:x1870705583040896:12345-192.168.204.50@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784044266.904114:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:13706:x1870705583040896:12345-192.168.204.50@tcp:40:mount.lustre.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044266.904122:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:2.0:1784044266.906256:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044266.906342:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583041024 00000100:00100000:1.0:1784044266.906351:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583041024 00000100:00100000:1.0:1784044266.906401:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:1.0:1784044266.906409:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1870705583041024:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784044266.906453:0:14910:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a2688e73-1cb4-4d8a-8c75-d614a6f1c88e@192.168.204.50@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:1.0:1784044266.906486:0:14910:0:(genops.c:1406:class_connect()) connect: client a2688e73-1cb4-4d8a-8c75-d614a6f1c88e, cookie 0x9cc73983a7551416 00002000:00100000:1.0:1784044266.906498:0:14910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a2688e73-1cb4-4d8a-8c75-d614a6f1c88e/ffff904bc635f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784044266.906522:0:14910:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784044266.907072:0:14910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784044266.907105:0:14910:0:(import.c:65:import_set_state_nolock()) ffff904bc6358000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044266.907267:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:2344:x1870705583041024:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 856us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044266.907276:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1784044266.909587:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044266.909650:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044266.909785:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583041152 00000100:00100000:1.0:1784044266.909795:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583041152 00000100:00100000:1.0:1784044266.909844:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:1.0:1784044266.909859:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1870705583041152:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784044266.909908:0:14911:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from a2688e73-1cb4-4d8a-8c75-d614a6f1c88e@192.168.204.50@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:1.0:1784044266.909943:0:14911:0:(genops.c:1406:class_connect()) connect: client a2688e73-1cb4-4d8a-8c75-d614a6f1c88e, cookie 0x9cc73983a755141d 00002000:00100000:1.0:1784044266.909955:0:14911:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a2688e73-1cb4-4d8a-8c75-d614a6f1c88e/ffff904bc635b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784044266.909978:0:14911:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784044266.910153:0:14911:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784044266.910182:0:14911:0:(import.c:65:import_set_state_nolock()) ffff904bc635f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044266.910238:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:2344:x1870705583041152:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 385us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044266.910246:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:2.0:1784044266.910590:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583041280 00000100:00100000:2.0:1784044266.910596:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583041280 00000100:00100000:2.0:1784044266.910632:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1784044266.910647:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:13706:x1870705583041280:12345-192.168.204.50@tcp:33:mount.lustre.0 00000004:00080000:3.0:1784044266.911893:0:14276:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1140us 00000004:00200000:2.0:1784044266.953914:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1784044266.954111:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:13706:x1870705583041280:12345-192.168.204.50@tcp:33:mount.lustre.0 Request processed in 43457us (44453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044266.954122:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:3.0:1784044267.217169:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044267.217501:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583041408 00000100:00100000:0.0:1784044267.217511:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583041408 00000100:00100000:0.0:1784044267.217583:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1784044267.217608:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:13747:x1870705583041408:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:0.0:1784044267.217630:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044267.217670:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eada7d expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044267.217763:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755142b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044267.217778:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755142b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044267.217793:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755142b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044267.218023:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784044267.218028:0:14274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044267.218121:0:14274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755142b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044267.218150:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada7d expref: 8 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044267.218167:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755142b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada7d expref: 7 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044267.218175:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59aa00) 00010000:00010000:0.0:1784044267.218179:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044267.218182:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6a00, rc 0) 00000100:00100000:0.0:1784044267.219348:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:13747:x1870705583041408:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 1734us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044267.219373:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00010000:00010000:3.0:1784044267.742362:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044268.446258:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598760064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044268.446330:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044268.447857:0:14913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598760064 00000100:00100000:0.0:1784044268.447903:0:14913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598760064 00000100:00080000:1.0:1784044268.448042:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044268.448169:0:14913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044268.448180:0:14913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598760064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044268.448219:0:14913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044268.448499:0:14913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1870705598760064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 322us (2168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044268.448508:0:14913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044268.455580:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1870705598760064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784044268.769830:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044269.228215:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044269.229984:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583041536 00000100:00100000:0.0:1784044269.230001:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583041536 00000100:00100000:0.0:1784044269.230101:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1784044269.230112:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:13799:x1870705583041536:12345-192.168.204.50@tcp:41:lfs.0 00000004:00000024:0.0:1784044269.230158:0:14273:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1784044269.230204:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044269.230264:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:13799:x1870705583041536:12345-192.168.204.50@tcp:41:lfs.0 Request processed in 153us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044269.230272:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:2.0:1784044269.234668:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044269.234893:0:15893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583041664 00000100:00100000:0.0:1784044269.234903:0:15893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583041664 00000100:00100000:0.0:1784044269.234986:0:15893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:0.0:1784044269.234998:0:15893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:13799:x1870705583041664:12345-192.168.204.50@tcp:13:lfs.0 00002000:00000024:0.0:1784044269.235027:0:15893:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1784044269.235063:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044269.235132:0:15893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:13799:x1870705583041664:12345-192.168.204.50@tcp:13:lfs.0 Request processed in 126us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044269.235140:0:15893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1784044269.241369:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044269.245528:0:14913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583041792 00000100:00100000:0.0:1784044269.245543:0:14913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583041792 00000100:00100000:0.0:1784044269.245725:0:14913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1784044269.245737:0:14913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:13799:x1870705583041792:12345-192.168.204.50@tcp:13:lfs.0 00002000:00000024:0.0:1784044269.245778:0:14913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1784044269.245822:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044269.245915:0:14913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:13799:x1870705583041792:12345-192.168.204.50@tcp:13:lfs.0 Request processed in 180us (4554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044269.245923:0:14913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1784044269.394175:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044269.394365:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583041920 00000100:00100000:2.0:1784044269.394381:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583041920 00000100:00100000:2.0:1784044269.394461:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:2.0:1784044269.394474:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+10:13830:x1870705583041920:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784044269.394496:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044269.394521:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc81f4400/0x9cc73983a7551432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eada84 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044269.394561:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f4400/0x9cc73983a7551432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada84 expref: 11 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044269.394574:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc81f4400/0x9cc73983a7551432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada84 expref: 11 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044269.394585:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4400, rc 0) 00000100:00100000:2.0:1784044269.398690:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13830:x1870705583041920:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 4198us (4508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044269.399612:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:3.0:1784044269.413167:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044269.413272:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583042048 00000100:00100000:0.0:1784044269.413286:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583042048 00000100:00100000:0.0:1784044269.413641:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:0.0:1784044269.413673:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13830:x1870705583042048:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784044269.414094:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13830:x1870705583042048:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 422us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044269.414103:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:3.0:1784044269.424728:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044269.424857:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583042176 00000100:00100000:2.0:1784044269.425028:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583042176 00000100:00100000:2.0:1784044269.425159:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:2.0:1784044269.425172:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13830:x1870705583042176:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784044269.425466:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13830:x1870705583042176:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 296us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044269.425475:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:1.0:1784044269.433476:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044269.433601:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583042304 00000100:00100000:0.0:1784044269.433614:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583042304 00000100:00100000:0.0:1784044269.433698:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:0.0:1784044269.433711:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13837:x1870705583042304:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044269.434195:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13837:x1870705583042304:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 485us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044269.434206:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:3.0:1784044269.452514:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044269.456329:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583042432 00000100:00100000:2.0:1784044269.456351:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583042432 00000100:00100000:2.0:1784044269.456508:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:2.0:1784044269.456521:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13837:x1870705583042432:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044269.456956:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13837:x1870705583042432:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 436us (4456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044269.456967:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:0.0:1784044269.470460:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598760192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044269.470562:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044269.470677:0:15893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598760192 00000100:00100000:0.0:1784044269.470716:0:15893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598760192 00000100:00100000:0.0:1784044269.470790:0:15893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044269.470799:0:15893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598760192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044269.470844:0:15893:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044269.470917:0:15893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598760192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044269.470926:0:15893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044269.470985:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598760192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044269.471405:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598760320:0@lo:400:kworker.0 00000100:00100000:2.0:1784044269.471450:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044269.471478:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598760832:0@lo:400:kworker.0 00000100:00100000:2.0:1784044269.471511:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044269.471533:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044269.471540:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff59b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598760704:0@lo:400:kworker.0 00000100:00100000:2.0:1784044269.471561:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044269.471590:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598760832 00000100:00100000:2.0:1784044269.471595:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598760832 00000100:00100000:2.0:1784044269.471638:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598760704 00000100:00100000:2.0:1784044269.471641:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598760704 00000100:00100000:2.0:1784044269.471671:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044269.471678:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598760832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044269.471724:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1870705598760832:12345-0@lo:400:kworker.0 Request processed in 46us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044269.471743:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044269.471758:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784044269.471765:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598760704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044269.471793:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598760704:12345-0@lo:400:kworker.0 Request processed in 29us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044269.471799:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784044269.471842:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598760704:0@lo:400:kworker.0 00000100:00100000:2.0:1784044269.471853:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1870705598760832:0@lo:400:kworker.0 00000100:00100000:2.0:1784044269.471901:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598760320 00000100:00100000:2.0:1784044269.471905:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598760320 00000100:00100000:2.0:1784044269.471929:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784044269.471936:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3289:x1870705598760320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044269.471970:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3289:x1870705598760320:12345-0@lo:400:kworker.0 Request processed in 35us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044269.471977:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784044269.472020:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff59b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598760320:0@lo:400:kworker.0 00000100:00100000:1.0:1784044269.472497:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598760448:0@lo:400:kworker.0 00000100:00100000:1.0:1784044269.472541:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044269.472568:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044269.472574:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598760576:0@lo:400:kworker.0 00000100:00100000:1.0:1784044269.472597:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044269.472624:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598760448 00000100:00100000:1.0:1784044269.472628:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598760448 00000100:00100000:1.0:1784044269.472673:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044269.472681:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598760448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044269.472731:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598760448:12345-0@lo:400:kworker.0 Request processed in 51us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044269.472738:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044269.472757:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598760576 00000100:00100000:1.0:1784044269.472761:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598760576 00000100:00100000:1.0:1784044269.472796:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044269.472813:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598760576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044269.472841:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1870705598760576:12345-0@lo:400:kworker.0 Request processed in 39us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044269.472848:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1784044269.472890:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044269.472907:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044269.472939:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1870705598760576:0@lo:400:kworker.0 00000100:00100000:1.0:1784044269.472949:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598760448:0@lo:400:kworker.0 00000100:00100000:3.0:1784044269.476921:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044269.476963:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583042560 00000100:00100000:3.0:1784044269.476976:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583042560 00000100:00100000:3.0:1784044269.477051:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:3.0:1784044269.477064:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13830:x1870705583042560:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784044269.477087:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044269.477110:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9aa00/0x9cc73983a7551439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadaae expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044269.477146:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9aa00/0x9cc73983a7551439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadaae expref: 12 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044269.477159:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9aa00/0x9cc73983a7551439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadaae expref: 12 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044269.477171:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9aa00, rc 0) 00000100:00100000:3.0:1784044269.477245:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:13830:x1870705583042560:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 183us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044269.477255:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:2.0:1784044269.489192:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044269.491969:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583042688 00000100:00100000:0.0:1784044269.491993:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583042688 00000100:00100000:0.0:1784044269.492131:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:0.0:1784044269.492142:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:13830:x1870705583042688:12345-192.168.204.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784044269.492174:0:14266:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784044269.492203:0:14266:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784044269.492208:0:14266:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784044269.492211:0:14266:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784044269.492214:0:14266:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1784044269.500968:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:13830:x1870705583042688:12345-192.168.204.50@tcp:256:mount.lustre.0 Request processed in 8631us (11593us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044269.500988:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:1.0:1784044269.506246:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044269.506540:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583042816 00000100:00100000:1.0:1784044269.506553:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583042816 00000100:00100000:1.0:1784044269.506619:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:1.0:1784044269.506632:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:13830:x1870705583042816:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784044269.506669:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044269.506693:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1663400/0x9cc73983a7551440 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadab5 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.506731:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1663400/0x9cc73983a7551440 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadab5 expref: 13 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.506744:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1663400/0x9cc73983a7551440 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadab5 expref: 13 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.506755:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663400, rc 0) 00000100:00100000:1.0:1784044269.506836:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13830:x1870705583042816:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 207us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044269.506844:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:2.0:1784044269.520416:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044269.520476:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583042944 00000100:00100000:2.0:1784044269.520490:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583042944 00000100:00100000:2.0:1784044269.520553:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:2.0:1784044269.520566:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13830:x1870705583042944:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784044269.523927:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13830:x1870705583042944:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 3348us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044269.523958:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:3.0:1784044269.532358:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044269.532412:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583043072 00000100:00100000:3.0:1784044269.532425:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583043072 00000100:00100000:3.0:1784044269.532487:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:3.0:1784044269.532499:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13830:x1870705583043072:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784044269.532803:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13830:x1870705583043072:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 304us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044269.532812:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:3.0:1784044269.539152:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044269.539204:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583043200 00000100:00100000:3.0:1784044269.539216:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583043200 00000100:00100000:3.0:1784044269.539278:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:3.0:1784044269.539291:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13843:x1870705583043200:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784044269.539592:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13843:x1870705583043200:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 301us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044269.539603:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:3.0:1784044269.547937:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044269.548170:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583043328 00000100:00100000:1.0:1784044269.548184:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583043328 00000100:00100000:1.0:1784044269.548268:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:1.0:1784044269.548279:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13843:x1870705583043328:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044269.548596:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13843:x1870705583043328:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 318us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044269.548606:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:1.0:1784044269.558977:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044269.559026:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583043456 00000100:00100000:1.0:1784044269.559038:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583043456 00000100:00100000:1.0:1784044269.559089:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1784044269.559099:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2344:x1870705583043456:12345-192.168.204.50@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784044269.559138:0:14273:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9@192.168.204.50@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:1.0:1784044269.559187:0:14273:0:(genops.c:1406:class_connect()) connect: client 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9, cookie 0x9cc73983a7551447 00000004:00100000:1.0:1784044269.559228:0:14273:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784044269.559380:0:14273:0:(import.c:65:import_set_state_nolock()) ffff904bc635a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044269.559468:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:2344:x1870705583043456:12345-192.168.204.50@tcp:38:mount.lustre.0 Request processed in 368us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044269.559478:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1784044269.563800:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044269.563930:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583043584 00000100:00100000:1.0:1784044269.563943:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583043584 00000100:00100000:1.0:1784044269.564019:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044269.564031:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:0:x1870705583043584:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784044269.564073:0:14274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784044269.564164:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:0:x1870705583043584:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 135us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044269.564173:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00080000:1.0:1784044269.564210:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044269.564294:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044269.564371:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583043712 00000100:00100000:1.0:1784044269.564376:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583043712 00000100:00100000:1.0:1784044269.564596:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1784044269.564604:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:13830:x1870705583043712:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784044269.564619:0:14275:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784044269.564665:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:13830:x1870705583043712:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 62us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044269.564672:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1784044269.566118:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044269.566266:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583043840 00000100:00100000:3.0:1784044269.566277:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583043840 00000100:00100000:3.0:1784044269.566328:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:3.0:1784044269.566338:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:13830:x1870705583043840:12345-192.168.204.50@tcp:40:mount.lustre.0 00000100:00100000:3.0:1784044269.566427:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:13830:x1870705583043840:12345-192.168.204.50@tcp:40:mount.lustre.0 Request processed in 89us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044269.566435:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1784044269.571231:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044269.571326:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044269.573436:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00100000:1.0:1784044269.573494:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784044269.573507:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a2688e73-1cb4-4d8a-8c75-d614a6f1c88e 00000001:00080000:1.0:1784044269.573517:0:7484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:3.0:1784044269.573974:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583044224 00000100:00100000:3.0:1784044269.573988:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583044224 00000100:00100000:3.0:1784044269.574069:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1784044269.574081:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:13830:x1870705583044224:12345-192.168.204.50@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784044269.574455:0:14277:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1784044269.574623:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:13830:x1870705583044224:12345-192.168.204.50@tcp:33:mount.lustre.0 Request processed in 543us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044269.574632:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:2.0:1784044269.575396:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583043968 00000100:00100000:2.0:1784044269.575406:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583043968 00000100:00100000:0.0:1784044269.575506:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583044096 00000100:00100000:0.0:1784044269.575511:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583044096 00000100:00100000:0.0:1784044269.575589:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1784044269.575598:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2344:x1870705583044096:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784044269.575634:0:14909:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9@192.168.204.50@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1784044269.575692:0:14909:0:(genops.c:1406:class_connect()) connect: client 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9, cookie 0x9cc73983a755144e 00002000:00100000:0.0:1784044269.575717:0:14909:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9/ffff904bfb32c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784044269.575732:0:14909:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784044269.576114:0:14909:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784044269.576151:0:14909:0:(import.c:65:import_set_state_nolock()) ffff904bfb32e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044269.576229:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:2344:x1870705583044096:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 630us (4902us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044269.576237:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1784044269.576729:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044269.576737:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904ac2b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1870705583043968:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784044269.576761:0:14911:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9@192.168.204.50@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:1.0:1784044269.576801:0:14911:0:(genops.c:1406:class_connect()) connect: client 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9, cookie 0x9cc73983a7551455 00002000:00100000:1.0:1784044269.576818:0:14911:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9/ffff904bc635c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784044269.576829:0:14911:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784044269.576923:0:14911:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784044269.576941:0:14911:0:(import.c:65:import_set_state_nolock()) ffff904bc728b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044269.577006:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904ac2b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:2344:x1870705583043968:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 268us (5790us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044269.577015:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044269.731529:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044269.731695:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583044352 00000100:00100000:0.0:1784044269.731717:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583044352 00000100:00100000:0.0:1784044269.731789:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1784044269.731801:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:13864:x1870705583044352:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:0.0:1784044269.731822:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044269.731844:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a755145c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadadf expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044269.732247:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044269.732263:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044269.732275:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044269.732532:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784044269.732536:0:14274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044269.732622:0:14274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044269.732661:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a755145c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadadf expref: 8 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044269.732694:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadadf expref: 7 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044269.732766:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59aa00) 00010000:00010000:0.0:1784044269.732769:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044269.732773:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6200, rc 0) 00000100:00100000:0.0:1784044269.732848:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+7:13864:x1870705583044352:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 1048us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044269.732857:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00010000:00010000:3.0:1784044269.790483:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044270.814818:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784044271.572731:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9 00000001:00100000:3.0:1784044271.572747:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2688e73-1cb4-4d8a-8c75-d614a6f1c88e 00010000:00010000:3.0:1784044271.838226:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784044272.085585:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9 00000001:00100000:3.0:1784044272.085617:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a2688e73-1cb4-4d8a-8c75-d614a6f1c88e 00000001:02000400:2.0:1784044272.293525:0:16139:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1784044272.862140:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044273.566142:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598760960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044273.566239:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044273.566333:0:14913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598760960 00000100:00100000:3.0:1784044273.566340:0:14913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598760960 00000100:00100000:3.0:1784044273.566409:0:14913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784044273.566419:0:14913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598760960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044273.566469:0:14913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044273.566520:0:14913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598760960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044273.566528:0:14913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1784044273.566555:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044273.566617:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598760960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784044273.887387:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044274.334840:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784044274.590294:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044274.590361:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598761088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044274.590466:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044274.590606:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598761088 00000100:00100000:3.0:1784044274.590615:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598761088 00000100:00100000:3.0:1784044274.590695:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784044274.590711:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598761088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044274.590760:0:14912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044274.590825:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598761088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044274.590833:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1784044274.590906:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044274.590957:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1784044274.590985:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598761088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044274.591384:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d72db5ce-ca39-4323-bf26-8b60fe27b493:3288:1870705598761216:0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.591429:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044274.591458:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598761728:0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.591488:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044274.591510:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044274.591516:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598761344:0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.591539:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044274.591586:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598761216 00000100:00100000:3.0:1784044274.591592:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598761216 00000100:00100000:3.0:1784044274.591628:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784044274.591635:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3288:x1870705598761216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.591675:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3288:x1870705598761216:12345-0@lo:400:kworker.0 Request processed in 40us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044274.591681:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784044274.591713:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598761728 00000100:00100000:3.0:1784044274.591726:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598761728 00000100:00100000:3.0:1784044274.591762:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044274.591768:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598761728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.591801:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870705598761728:12345-0@lo:400:kworker.0 Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044274.591807:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044274.591828:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598761344 00000100:00100000:3.0:1784044274.591832:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598761344 00000100:00100000:3.0:1784044274.591861:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044274.591892:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598761344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.591925:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870705598761344:12345-0@lo:400:kworker.0 Request processed in 35us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044274.591931:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044274.591962:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598761600:0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.591990:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044274.592011:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044274.592016:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598761472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.592037:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044274.592063:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598761600 00000100:00100000:3.0:1784044274.592067:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598761600 00000100:00100000:3.0:1784044274.592090:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598761472 00000100:00100000:3.0:1784044274.592093:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598761472 00000100:00100000:3.0:1784044274.592107:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784044274.592113:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598761600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.592146:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598761600:12345-0@lo:400:kworker.0 Request processed in 32us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044274.592152:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784044274.592172:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044274.592177:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598761472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.592206:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1870705598761472:12345-0@lo:400:kworker.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044274.592212:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1784044274.592229:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044274.592251:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1870705598761472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.592260:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598761600:0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.592285:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598761344:0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.592293:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d72db5ce-ca39-4323-bf26-8b60fe27b493:3288:1870705598761216:0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.592300:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1870705598761728:0@lo:400:kworker.0 00000001:00100000:1.0:1784044274.663145:0:7484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9 00010000:00010000:1.0:1784044274.910051:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044275.067014:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044275.067133:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044275.067180:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044275.067226:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044275.067285:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583044736 00000100:00100000:2.0:1784044275.067297:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583044736 00000100:00100000:1.0:1784044275.067377:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583044992 00000100:00100000:2.0:1784044275.067379:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583045248 00000100:00100000:2.0:1784044275.067382:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583045248 00000100:00100000:1.0:1784044275.067382:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583044992 00000100:00100000:2.0:1784044275.067405:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1784044275.067416:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1784044275.067417:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2346:x1870705583044736:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044275.067423:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:2346:x1870705583044992:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1784044275.067506:0:14910:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1784044275.067519:0:14910:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784044275.067936:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2346:x1870705583044736:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 520us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044275.067946:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:2.0:1784044275.067972:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:2.0:1784044275.067979:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2346:x1870705583045248:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044275.068490:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583044480 00000100:00100000:3.0:1784044275.068500:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583044480 00000100:00100000:3.0:1784044275.068555:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 103 00000100:00100000:3.0:1784044275.068564:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:2346:x1870705583044480:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044275.073038:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:2346:x1870705583044992:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 5590us (5832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044275.073075:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00080000:1.0:1784044275.073210:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044275.073228:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044275.073232:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044275.073286:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2346:x1870705583045248:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 5301us (6053us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044275.073296:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:2.0:1784044275.073432:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044275.073488:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044275.073500:0:16258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583044864 00000100:00100000:2.0:1784044275.073511:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044275.073511:0:16258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583044864 00000100:00100000:2.0:1784044275.073527:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583045120 00000100:00100000:2.0:1784044275.073530:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583045120 00000100:00080000:1.0:1784044275.073551:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044275.073553:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044275.075010:0:16258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:1.0:1784044275.075028:0:16258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff59bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2345:x1870705583045120:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044275.075203:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:2346:x1870705583044480:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 6637us (8202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044275.075216:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 103 00000100:00100000:3.0:1784044275.075271:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583044608 00000100:00100000:3.0:1784044275.075280:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583044608 00000100:00100000:3.0:1784044275.075336:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:3.0:1784044275.075343:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:2345:x1870705583044608:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044275.075391:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:2345:x1870705583044608:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 48us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044275.075413:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00080000:3.0:1784044275.075433:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044275.075467:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1784044275.075476:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bff599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2345:x1870705583044864:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044275.075496:0:16258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff59bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2345:x1870705583045120:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 472us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044275.075505:0:16258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1784044275.075512:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bff599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2345:x1870705583044864:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 37us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044275.075522:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000020:00000080:2.0:1784044275.560336:0:16289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3fefa9c0 20000000:00000080:2.0:1784044275.560363:0:16289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff904ac3468400 uarg=0000000000000000 20000000:01000000:2.0:1784044275.560418:0:16289:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784044275.560426:0:16289:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784044275.560433:0:16289:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784044275.564172:0:16290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1784044275.564433:0:16289:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784044275.573713:0:16289:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784044275.573760:0:16289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.573790:0:16289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904beeee6e00/0x9cc73983a7551161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755115a expref: 18 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.573800:0:16289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bffa9b600/0x9cc73983a75511ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75511a7 expref: 18 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.573962:0:16289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904beeee7200/0x9cc73983a75512e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a75512db expref: 18 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.573974:0:16289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada53 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.573981:0:16289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff904bc1663400/0x9cc73983a7551440 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadab5 expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.573991:0:16289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.574075:0:16289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bc1663400/0x9cc73983a7551440 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadab5 expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.574093:0:16289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904bc1663400/0x9cc73983a7551440 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadab5 expref: 12 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044275.574112:0:16289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1870705598761856:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044275.574297:0:16289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada53 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.574307:0:16289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada53 expref: 12 pid: 14266 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044275.574317:0:16289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff599180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1870705598761984:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044275.574351:0:16289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904beeee7200/0x9cc73983a75512e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a75512db expref: 18 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.574360:0:16289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904beeee7200/0x9cc73983a75512e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a75512db expref: 18 pid: 14266 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044275.574370:0:16289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1870705598762112:0@lo:104: 00000100:00100000:2.0:1784044275.574434:0:16289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044275.574469:0:16289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904bffa9b600/0x9cc73983a75511ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a75511a7 expref: 18 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.574477:0:16289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904bffa9b600/0x9cc73983a75511ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a75511a7 expref: 18 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044275.574498:0:16289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0232d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1870705598762240:0@lo:104: 00000100:00100000:2.0:1784044275.574522:0:16289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044275.574630:0:16289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff904beeee6e00/0x9cc73983a7551161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9cc73983a755115a expref: 18 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.574639:0:16289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff904beeee6e00/0x9cc73983a7551161 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9cc73983a755115a expref: 18 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044275.574648:0:16289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1870705598762368:0@lo:104: 00000100:00100000:2.0:1784044275.574676:0:16289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044275.574688:0:16289:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc89793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044275.575333:0:14256:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784044275.575357:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598762112 00000100:00100000:3.0:1784044275.575364:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598762112 00000100:00100000:3.0:1784044275.575473:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598762240 00000100:00100000:3.0:1784044275.575478:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598762240 00000100:00100000:3.0:1784044275.575491:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598762368 00000100:00100000:3.0:1784044275.575493:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598762368 00000100:00100000:3.0:1784044275.575508:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044275.575519:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+5:16289:x1870705598762112:12345-0@lo:104: 00010000:00010000:3.0:1784044275.575548:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.575759:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044275.575766:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+5:16289:x1870705598762112:12345-0@lo:104: Request processed in 249us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044275.575774:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044275.575796:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044275.575812:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+4:16289:x1870705598762240:12345-0@lo:104: 00010000:00010000:3.0:1784044275.575821:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.575897:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784044275.575903:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+4:16289:x1870705598762240:12345-0@lo:104: Request processed in 102us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044275.575909:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044275.575924:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784044275.575930:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf7378050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+3:16289:x1870705598762368:12345-0@lo:104: 00010000:00010000:3.0:1784044275.575937:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.575976:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784044275.575980:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf7378050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d72db5ce-ca39-4323-bf26-8b60fe27b493+3:16289:x1870705598762368:12345-0@lo:104: Request processed in 52us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044275.575986:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1784044275.576028:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784044275.576035:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576043:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4e00 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:3.0:1784044275.576048:0:14262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576057:0:14262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044275.576064:0:14262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044275.576072:0:14262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784044275.576122:0:14262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576129:0:14262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044275.576155:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576163:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f4e00/0x9cc73983a75512db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75512e2 expref: -99 pid: 15575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576176:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044275.576180:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576185:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5000 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:3.0:1784044275.576188:0:14262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576195:0:14262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044275.576203:0:14262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044275.576208:0:14262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784044275.576220:0:14262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576225:0:14262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044275.576240:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576259:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904bc81f5000/0x9cc73983a75511a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a75511ae expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576281:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044275.576284:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576290:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc000 already unused, calling callback (ffffffffc1b2fc20) 10000000:00010000:3.0:1784044275.576294:0:14262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576302:0:14262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044275.576308:0:14262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044275.576313:0:14262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784044275.576327:0:14262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576333:0:14262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044275.576340:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576346:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff904beb0fc000/0x9cc73983a755115a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9cc73983a7551161 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576362:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044275.576368:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044275.576370:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044275.576378:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044275.576401:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598762496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044275.576453:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044275.576514:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d72db5ce-ca39-4323-bf26-8b60fe27b493:3290:1870705598762624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044275.576553:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044275.576652:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044275.576659:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d72db5ce-ca39-4323-bf26-8b60fe27b493:3290:1870705598762752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044275.576684:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044275.576739:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598762496 00000100:00100000:3.0:1784044275.576745:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598762496 00010000:00010000:3.0:1784044275.576766:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904beeee7200/0x9cc73983a75512e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75512db expref: 19 pid: 14266 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044275.576784:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598762624 00000100:00100000:3.0:1784044275.576787:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598762624 00010000:00010000:3.0:1784044275.576799:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bffa9b600/0x9cc73983a75511ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75511a7 expref: 20 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044275.576809:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598762752 00000100:00100000:3.0:1784044275.576812:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598762752 00010000:00010000:3.0:1784044275.576821:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904beeee6e00/0x9cc73983a7551161 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a755115a expref: 21 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044275.576834:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044275.576840:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+21:3289:x1870705598762496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044275.576853:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044275.576859:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904beeee7200/0x9cc73983a75512e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75512db expref: 21 pid: 14266 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576905:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904beeee7200/0x9cc73983a75512e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a75512db expref: 21 pid: 14266 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.576927:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044275.576960:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+21:3289:x1870705598762496:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044275.576969:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044275.576987:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044275.576992:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+20:3290:x1870705598762624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044275.577001:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044275.577005:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bffa9b600/0x9cc73983a75511ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a75511a7 expref: 20 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.577013:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bffa9b600/0x9cc73983a75511ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a75511a7 expref: 20 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.577024:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044275.577051:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+20:3290:x1870705598762624:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044275.577057:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044275.577070:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784044275.577076:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3290:x1870705598762752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044275.577085:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044275.577088:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904beeee6e00/0x9cc73983a7551161 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9cc73983a755115a expref: 19 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.577097:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904beeee6e00/0x9cc73983a7551161 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9cc73983a755115a expref: 19 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044275.577114:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044275.577138:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3290:x1870705598762752:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044275.577144:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784044275.577212:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598762496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044275.577238:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d72db5ce-ca39-4323-bf26-8b60fe27b493:3290:1870705598762752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044275.577246:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d72db5ce-ca39-4323-bf26-8b60fe27b493:3290:1870705598762624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044275.577722:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044275.578255:0:16289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beeee7200/0x9cc73983a75512e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a75512db expref: 18 pid: 14266 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044275.578345:0:16289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1870705598762112:0@lo:104: 00010000:00010000:2.0:1784044275.578362:0:16289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bffa9b600/0x9cc73983a75511ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a75511a7 expref: 17 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044275.578372:0:16289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0232d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1870705598762240:0@lo:104: 00010000:00010000:2.0:1784044275.578383:0:16289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904beeee6e00/0x9cc73983a7551161 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9cc73983a755115a expref: 16 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044275.578392:0:16289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1870705598762368:0@lo:104: 00000100:00100000:0.0:1784044275.580647:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044275.580691:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044275.580720:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583045376 00000100:00100000:1.0:1784044275.580731:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583045376 00010000:00010000:1.0:1784044275.580792:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551408 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada53 expref: 13 pid: 14266 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044275.580843:0:16289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff598000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1870705598761856:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044275.580855:0:16289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bff599180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1870705598761984:192.168.204.50@tcp:104: 00000100:00100000:1.0:1784044275.580918:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583045504 00000100:00100000:1.0:1784044275.580922:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583045504 00010000:00010000:2.0:1784044275.580930:0:16289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044275.580935:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff904bc1663400/0x9cc73983a7551440 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadab5 expref: 14 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044275.580949:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1784044275.580957:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+14:2347:x1870705583045376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044275.580975:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044275.580981:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada53 expref: 14 pid: 14266 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044275.581093:0:14260:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1784044275.581104:0:14260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1784044275.581382:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada53 expref: 14 pid: 14266 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044275.581407:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada53 expref: 14 pid: 14266 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044275.581411:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:2.0:1784044275.581421:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:2347:x1870705583045504:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044275.581425:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044275.581430:0:14260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044275.581434:0:14260:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff904bc1663400/0x9cc73983a7551440 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadab5 expref: 13 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.581444:0:14260:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff904bc1663400/0x9cc73983a7551440 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadab5 expref: 13 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.581454:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc1663400/0x9cc73983a7551440 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadab5 expref: 13 pid: 14265 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.581468:0:14260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.581477:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.581492:0:14260:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044275.581496:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:2347:x1870705583045376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 539us (864us total) trans 0 rc 0/0 00010000:00010000:2.0:1784044275.581500:0:14260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044275.581504:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00010000:00010000:2.0:1784044275.581508:0:14260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.581514:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.581544:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5c00 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044275.581549:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.581673:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.581698:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044275.581709:0:14260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044275.581740:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:2347:x1870705583045504:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 321us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044275.581747:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00010000:00010000:1.0:1784044275.582550:0:16289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044275.582563:0:16289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044275.582581:0:16289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff904bc81f5c00/0x9cc73983a755146a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044275.934137:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044276.960095:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784044277.219910:0:14269:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784044277.219922:0:14269:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bcff24000 from 10 10000000:01000000:0.0:1784044277.219930:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784044277.219998:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a7551471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044277.220012:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a7551471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044277.220034:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a7551471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044277.220093:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598762880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044277.220197:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044277.220276:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc67c2240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044277.220387:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598762880 00000100:00100000:3.0:1784044277.220399:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598762880 00000100:00100000:3.0:1784044277.220481:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784044277.220493:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+16:14269:x1870705598762880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044277.220522:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044277.220542:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9ae00/0x9cc73983a7551478 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a7551471 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.220574:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9ae00/0x9cc73983a7551478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a7551471 expref: 17 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.220588:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9ae00/0x9cc73983a7551478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a7551471 expref: 17 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.220598:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9ae00, rc 0) 00000100:00100000:3.0:1784044277.220671:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:14269:x1870705598762880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044277.220679:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784044277.221034:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598762880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044277.221054:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a7551471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551478 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044277.221066:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a7551471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551478 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044277.221144:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044277.221187:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044277.221225:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc67c2240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044277.221437:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598763008 00000100:00100000:3.0:1784044277.221443:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598763008 00000100:00100000:3.0:1784044277.221483:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784044277.221492:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:14269:x1870705598763008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044277.221936:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:14269:x1870705598763008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 442us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044277.221945:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784044277.226338:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044277.226436:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5adea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044277.226566:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044277.226630:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc67c2240 going to sleep for 11 seconds 00000100:00100000:1.0:1784044277.226666:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598763136 00000100:00100000:1.0:1784044277.226676:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598763136 00000100:00100000:1.0:1784044277.226778:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784044277.226791:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:14269:x1870705598763136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044277.227202:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:14269:x1870705598763136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 410us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044277.227214:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784044277.227314:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5adea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784044277.237069:0:16343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1784044277.239379:0:14269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1784044277.239418:0:14269:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044277.239436:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a7551471 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551478 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044277.239452:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904beeee7800/0x9cc73983a7551471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551478 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044277.239467:0:14269:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044277.239471:0:14269:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bfb3aa800 from 10 10000000:01000000:1.0:1784044277.239474:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044277.239552:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662c00/0x9cc73983a755147f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044277.239562:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bc1662c00/0x9cc73983a755147f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044277.239575:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bc1662c00/0x9cc73983a755147f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044277.239639:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044277.239745:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044277.239806:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc6701840 going to sleep for 11 seconds 00000100:00100000:3.0:1784044277.239831:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598763264 00000100:00100000:3.0:1784044277.239841:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598763264 00000100:00100000:3.0:1784044277.239924:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784044277.239937:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+17:14269:x1870705598763264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044277.239956:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044277.239974:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755147f expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.240006:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755147f expref: 18 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.240019:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9b400/0x9cc73983a7551486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755147f expref: 18 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.240030:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9b400, rc 0) 00000100:00100000:3.0:1784044277.240185:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:14269:x1870705598763264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044277.240205:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784044277.245229:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044277.245276:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bc1662c00/0x9cc73983a755147f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551486 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044277.245294:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bc1662c00/0x9cc73983a755147f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551486 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044277.245418:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044277.245518:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044277.245566:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc8979cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044277.250362:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598763392 00000100:00100000:3.0:1784044277.250388:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598763392 00000100:00100000:3.0:1784044277.250470:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784044277.250483:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:14269:x1870705598763392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044277.250986:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:14269:x1870705598763392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 504us (5467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044277.250996:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784044277.251082:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044277.251157:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044277.251213:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044277.251251:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1784044277.251268:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598763520 00000100:00100000:3.0:1784044277.251272:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598763520 00000100:00100000:3.0:1784044277.251297:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784044277.251304:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:14269:x1870705598763520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044277.251472:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:14269:x1870705598763520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044277.251479:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784044277.251529:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784044277.255749:0:16346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1784044277.257360:0:14269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1784044277.257401:0:14269:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044277.257417:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bc1662c00/0x9cc73983a755147f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551486 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.257450:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bc1662c00/0x9cc73983a755147f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551486 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044277.257464:0:14269:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044277.257467:0:14269:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff904bc7f70800 from 10 10000000:01000000:3.0:1784044277.257471:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044277.257530:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9b600/0x9cc73983a755148d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.257540:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff904bffa9b600/0x9cc73983a755148d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.257553:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff904bffa9b600/0x9cc73983a755148d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044277.257592:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044277.257697:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044277.257756:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd41c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1784044277.257908:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598763648 00000100:00100000:0.0:1784044277.257917:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598763648 00000100:00100000:0.0:1784044277.257985:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784044277.257996:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+18:14269:x1870705598763648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044277.258013:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044277.258029:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904beeee7c00/0x9cc73983a7551494 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cc73983a755148d expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044277.258074:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904beeee7c00/0x9cc73983a7551494 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9cc73983a755148d expref: 19 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044277.258086:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904beeee7c00/0x9cc73983a7551494 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9cc73983a755148d expref: 19 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044277.258098:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7c00, rc 0) 00000100:00100000:0.0:1784044277.258151:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:14269:x1870705598763648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044277.258159:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784044277.258224:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044277.258241:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff904bffa9b600/0x9cc73983a755148d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551494 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044277.258252:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff904bffa9b600/0x9cc73983a755148d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9cc73983a7551494 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044277.258321:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044277.258348:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044277.258363:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc67c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1784044277.258390:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598763776 00000100:00100000:0.0:1784044277.258394:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598763776 00000100:00100000:0.0:1784044277.258415:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784044277.258421:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:14269:x1870705598763776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044277.258756:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:14269:x1870705598763776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044277.258774:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784044277.258824:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044277.258893:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044277.258941:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044277.258964:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc63fff00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044277.258977:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598763904 00000100:00100000:0.0:1784044277.258981:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598763904 00000100:00100000:0.0:1784044277.259005:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784044277.259012:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:14269:x1870705598763904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044277.259202:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:14269:x1870705598763904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044277.259210:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784044277.259266:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d72db5ce-ca39-4323-bf26-8b60fe27b493:14269:1870705598763904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784044277.262594:0:16348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1784044277.262853:0:14269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1784044277.262940:0:14269:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044277.262955:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff904bffa9b600/0x9cc73983a755148d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551494 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044277.262970:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff904bffa9b600/0x9cc73983a755148d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9cc73983a7551494 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044277.435484:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044277.436295:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583045632 00000100:00100000:2.0:1784044277.436310:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583045632 00000100:00100000:3.0:1784044277.436445:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:3.0:1784044277.436456:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+11:13720:x1870705583045632:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044277.436478:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044277.436513:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bffa9ba00/0x9cc73983a755149b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadae6 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.436553:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bffa9ba00/0x9cc73983a755149b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadae6 expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.436591:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bffa9ba00/0x9cc73983a755149b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadae6 expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044277.436603:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bffa9ba00, rc 0) 00000100:00100000:3.0:1784044277.436706:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:13720:x1870705583045632:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 251us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044277.436715:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:2.0:1784044277.442698:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044277.442792:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583045760 00000100:00100000:3.0:1784044277.442806:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583045760 00000100:00100000:3.0:1784044277.442973:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:3.0:1784044277.442987:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:13720:x1870705583045760:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044277.443534:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:13720:x1870705583045760:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 548us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044277.443545:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:3.0:1784044277.445415:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044277.445543:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583045888 00000100:00100000:0.0:1784044277.445555:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583045888 00000100:00100000:0.0:1784044277.445653:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:0.0:1784044277.445665:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:13720:x1870705583045888:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044277.446120:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:13720:x1870705583045888:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 392us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044277.446132:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:3.0:1784044277.472346:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044277.476231:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583046016 00000100:00100000:1.0:1784044277.476257:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583046016 00000100:00100000:1.0:1784044277.476343:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:1.0:1784044277.476357:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+12:13720:x1870705583046016:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044277.476382:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044277.476410:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff904bc1663e00/0x9cc73983a75514a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadaed expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044277.476451:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff904bc1663e00/0x9cc73983a75514a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadaed expref: 13 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044277.476465:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff904bc1663e00/0x9cc73983a75514a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadaed expref: 13 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044277.476477:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663e00, rc 0) 00000100:00100000:1.0:1784044277.476597:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13720:x1870705583046016:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 242us (4266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044277.476605:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1784044277.479009:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044277.479097:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583046144 00000100:00100000:3.0:1784044277.479109:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583046144 00000100:00100000:3.0:1784044277.479175:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:3.0:1784044277.479186:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13720:x1870705583046144:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044277.479620:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13720:x1870705583046144:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 431us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044277.479630:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:1.0:1784044277.485099:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044277.485249:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583046272 00000100:00100000:2.0:1784044277.485264:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583046272 00000100:00100000:2.0:1784044277.485347:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:2.0:1784044277.485360:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13720:x1870705583046272:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044277.485705:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:13720:x1870705583046272:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 346us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044277.485716:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 118 00010000:00010000:3.0:1784044277.990963:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044278.686222:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044278.686256:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598764032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044278.686354:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044278.686560:0:15893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598764032 00000100:00100000:3.0:1784044278.686573:0:15893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598764032 00000100:00100000:3.0:1784044278.686817:0:15893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044278.686830:0:15893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598764032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044278.686902:0:15893:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044278.686976:0:15893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598764032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044278.686984:0:15893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1784044278.687225:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044278.687716:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598764032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784044279.007093:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044279.471033:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044279.471301:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583046400 00000100:00100000:1.0:1784044279.471316:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583046400 00000100:00100000:1.0:1784044279.471425:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1784044279.471438:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:14374:x1870705583046400:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044279.471475:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044279.471509:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a75514a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadaf4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.471598:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.471617:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.471633:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.471650:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.471659:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.471685:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784044279.471914:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784044279.472780:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663c00/0x9cc73983a75514be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.472795:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663c00/0x9cc73983a75514be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.472805:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663c00/0x9cc73983a75514be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044279.472913:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784044279.472918:0:14273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784044279.476618:0:14273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663c00/0x9cc73983a75514be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476651:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476659:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476666:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476672:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044279.476678:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476685:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476723:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59aa00) 00010000:00010000:1.0:1784044279.476726:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044279.476733:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476740:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476758:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476765:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476771:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476777:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044279.476780:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476786:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476793:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff904bcb562b00) 00010000:00010000:1.0:1784044279.476795:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044279.476798:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476804:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476915:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a75514a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadaf4 expref: 8 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476933:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663c00/0x9cc73983a75514be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadaf4 expref: 7 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.476942:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff904bcb562d00) 00010000:00010000:1.0:1784044279.476944:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044279.476947:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663c00, rc 0) 00000100:00100000:1.0:1784044279.477334:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:14374:x1870705583046400:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 5896us (6314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044279.477447:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:3.0:1784044279.483328:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044279.483666:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583046656 00000100:00100000:1.0:1784044279.483681:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583046656 00000100:00100000:1.0:1784044279.483762:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1784044279.483775:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:14374:x1870705583046656:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044279.483808:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044279.483839:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadafb expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.484004:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514cc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.484024:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.484039:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.494669:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.494696:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.494709:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496423:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75514da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496444:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75514da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496465:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75514da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044279.496478:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1784044279.496753:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496760:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514cc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496767:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514cc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496774:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1663a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044279.496779:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514cc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496786:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514cc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496806:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff904bcb562d00) 00010000:00010000:0.0:1784044279.496809:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044279.496814:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496820:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1663a00/0x9cc73983a75514cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496833:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496839:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514d3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496845:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496850:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044279.496853:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496858:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514d3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496918:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff904bda59ac00) 00010000:00010000:0.0:1784044279.496920:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044279.496924:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514d3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.496928:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.497329:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662200/0x9cc73983a75514c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadafb expref: 10 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.497347:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6e00/0x9cc73983a75514da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadafb expref: 9 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.497354:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59a800) 00010000:00010000:0.0:1784044279.497356:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044279.497359:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6e00, rc 0) 00000100:00100000:0.0:1784044279.497431:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:14374:x1870705583046656:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 13659us (14119us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784044279.497440:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1784044279.514029:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044279.514342:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583046784 00000100:00100000:1.0:1784044279.514355:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583046784 00000100:00100000:1.0:1784044279.514439:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1784044279.514463:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:14374:x1870705583046784:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784044279.516810:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:14374:x1870705583046784:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 Request processed in 2344us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.516833:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1784044279.540415:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044279.540606:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583046912 00000100:00100000:0.0:1784044279.540621:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583046912 00000100:00100000:0.0:1784044279.541534:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:0.0:1784044279.541552:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:14380:x1870705583046912:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044279.541575:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044279.541599:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a75514e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb02 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.541670:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.541685:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.541696:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.541727:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75514f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.541734:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75514f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.541742:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75514f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542038:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542047:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542054:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542060:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044279.542065:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542088:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542101:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59aa00) 00010000:00010000:0.0:1784044279.542104:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044279.542109:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542115:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a75514ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542132:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75514f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542138:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75514f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542143:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75514f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542147:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044279.542150:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75514f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542156:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75514f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542164:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff904bda59ac00) 00010000:00010000:0.0:1784044279.542166:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044279.542169:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75514f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542174:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a75514f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542203:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a75514e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb02 expref: 10 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542214:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59aa00) 00010000:00010000:0.0:1784044279.542216:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044279.542227:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a75514e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb02 expref: 10 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.542236:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee6600, rc 0) 00000100:00100000:0.0:1784044279.542314:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:14380:x1870705583046912:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 768us (1917us total) trans 0 rc 301/301 00000100:00100000:0.0:1784044279.542321:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:0.0:1784044279.549070:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044279.549261:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583047040 00000100:00100000:2.0:1784044279.549271:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583047040 00000100:00100000:2.0:1784044279.549333:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1784044279.549343:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:14380:x1870705583047040:12345-192.168.204.50@tcp:700:lfs.0 00000100:00100000:2.0:1784044279.549426:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:14380:x1870705583047040:12345-192.168.204.50@tcp:700:lfs.0 Request processed in 85us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044279.549433:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:1.0:1784044279.552214:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044279.552329:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583047296 00000100:00100000:2.0:1784044279.552339:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583047296 00000100:00100000:2.0:1784044279.552460:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1784044279.552471:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:14380:x1870705583047296:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:2.0:1784044279.552537:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044279.552565:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755142b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eada7d expref: 9 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.552584:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59aa00) 00010000:00010000:2.0:1784044279.552597:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044279.552846:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.552959:0:14275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadadf expref: 5 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.552968:0:14275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.553000:0:14275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadadf expref: 5 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.553013:0:14275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadadf expref: 5 pid: 14274 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044279.553027:0:14275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14275:1870705598764160:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044279.553127:0:14275:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc8979f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044279.557846:0:14275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14275:1870705598764160:192.168.204.50@tcp:104: 00010000:00010000:1.0:1784044279.557921:0:14275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044279.558242:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044279.561362:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583047424 00000100:00100000:1.0:1784044279.561384:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583047424 00010000:00010000:1.0:1784044279.561493:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadadf expref: 6 pid: 14274 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044279.561551:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:1.0:1784044279.561564:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:2348:x1870705583047424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044279.561586:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044279.561596:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadadf expref: 6 pid: 14274 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784044279.561598:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784044279.561623:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadadf expref: 6 pid: 14274 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.561654:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551463 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadadf expref: 6 pid: 14274 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.561824:0:14259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59aa00) 00010000:00010000:1.0:1784044279.561831:0:14259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.561841:0:14259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.561850:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.561934:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044279.562031:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2348:x1870705583047424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 469us (3789us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044279.562041:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00010000:00010000:3.0:1784044279.562911:0:14275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.562929:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.562964:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.562980:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.562995:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044279.568445:0:14275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1784044279.568480:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.568492:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.568499:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.568505:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044279.568510:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.568517:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.568535:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bda59aa00) 00010000:00010000:3.0:1784044279.568538:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044279.568543:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.568549:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5000/0x9cc73983a75514fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044279.568569:0:14275:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006bb5099e reply state 0000000065a96969 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044279.568580:0:14275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784044279.568968:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+10:14380:x1870705583047296:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 16494us (16895us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784044279.568990:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00010000:00010000:0.0:1784044279.576522:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.576547:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.576557:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.576564:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044279.576571:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.576581:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.576606:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff904bc7c1eb00) 00010000:00010000:0.0:1784044279.576610:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044279.576616:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.576635:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551504 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044279.660955:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044279.663885:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583047552 00000100:00100000:3.0:1784044279.663909:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583047552 00000100:00100000:3.0:1784044279.664094:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:3.0:1784044279.664108:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:14388:x1870705583047552:12345-192.168.204.50@tcp:101:lctl.0 00010000:00010000:3.0:1784044279.664144:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044279.664176:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a755150b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb09 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.664263:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7551512 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.664280:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7551512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.664294:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7551512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044279.664370:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784044279.664374:0:14274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044279.664424:0:14274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7551512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.664464:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a755150b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb09 expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.664488:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fce00/0x9cc73983a7551512 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb09 expref: 10 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.664526:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e100) 00010000:00010000:3.0:1784044279.664529:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044279.664533:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fce00, rc 0) 00000100:00100000:3.0:1784044279.664633:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+10:14388:x1870705583047552:12345-192.168.204.50@tcp:101:lctl.0 Request processed in 527us (3692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.664642:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:2.0:1784044279.694774:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044279.694920:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583047680 00000100:00100000:3.0:1784044279.694934:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583047680 00000100:00100000:3.0:1784044279.695020:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:3.0:1784044279.695033:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:14389:x1870705583047680:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044279.695063:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044279.695093:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb10 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.695182:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7551520 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.695200:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7551520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.695217:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7551520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044279.695299:0:14275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784044279.695304:0:14275:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044279.695332:0:14275:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7551520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.695382:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb10 expref: 7 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.695403:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd200/0x9cc73983a7551520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb10 expref: 6 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.695412:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e100) 00010000:00010000:3.0:1784044279.695416:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044279.695419:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fd200, rc 0) 00000100:00100000:3.0:1784044279.695517:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:14389:x1870705583047680:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 487us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.695525:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:2.0:1784044279.699742:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044279.702605:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583047808 00000100:00100000:3.0:1784044279.702631:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583047808 00000100:00100000:3.0:1784044279.702740:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:3.0:1784044279.702754:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:14389:x1870705583047808:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044279.702787:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044279.702821:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551527 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb17 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.702955:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a755152e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.702972:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a755152e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.702988:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a755152e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703028:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7551535 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703037:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7551535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703045:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7551535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703183:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a755153c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703193:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a755153c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703201:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a755153c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044279.703253:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1784044279.703258:0:14274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044279.703287:0:14274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a755153c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703302:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a755152e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703311:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a755152e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703319:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a755152e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703337:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044279.703343:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a755152e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703354:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a755152e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703371:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e100) 00010000:00010000:3.0:1784044279.703374:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044279.703381:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a755152e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703388:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a755152e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703404:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7551535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703410:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7551535 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703415:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7551535 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703421:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fca00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044279.703424:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7551535 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703431:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7551535 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703462:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff904bc7c1ef00) 00010000:00010000:3.0:1784044279.703465:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044279.703469:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7551535 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703476:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a7551535 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703519:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551527 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb17 expref: 8 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703534:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a755153c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb17 expref: 7 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.703541:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bc7c1ec00) 00010000:00010000:3.0:1784044279.703544:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044279.703546:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fde00, rc 0) 00000100:00100000:3.0:1784044279.703639:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+7:14389:x1870705583047808:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 888us (3906us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.703648:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:0.0:1784044279.711738:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598764288:0@lo:400:kworker.0 00000100:00100000:0.0:1784044279.711848:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044279.711940:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598764800:0@lo:400:kworker.0 00000100:00100000:0.0:1784044279.711975:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044279.712013:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044279.712020:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598764672:0@lo:400:kworker.0 00000100:00100000:0.0:1784044279.712045:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044279.712140:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598764416:0@lo:400:kworker.0 00000100:00100000:3.0:1784044279.712182:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044279.712217:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598764928:0@lo:400:kworker.0 00000100:00100000:3.0:1784044279.712240:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044279.712260:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784044279.712266:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598764544:0@lo:400:kworker.0 00000100:00100000:3.0:1784044279.712313:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044279.712331:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bc5aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598765056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044279.712353:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044279.712390:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598764416 00000100:00100000:3.0:1784044279.712398:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598764416 00000100:00100000:3.0:1784044279.712464:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598764544 00000100:00100000:3.0:1784044279.712468:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598764544 00000100:00100000:3.0:1784044279.712506:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784044279.712515:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598764416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044279.712583:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598764416:12345-0@lo:400:kworker.0 Request processed in 68us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.712591:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784044279.712610:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044279.712617:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598764544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044279.712648:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598764544:12345-0@lo:400:kworker.0 Request processed in 31us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.712654:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044279.712674:0:14913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598765056 00000100:00100000:3.0:1784044279.712677:0:14913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598765056 00000100:00100000:3.0:1784044279.712712:0:14913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784044279.712721:0:14913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598765056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044279.712757:0:14913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784044279.712761:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598764800 00000100:00100000:2.0:1784044279.712775:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598764800 00000100:00100000:3.0:1784044279.712797:0:14913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598765056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.712804:0:14913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784044279.712838:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598764672 00000100:00080000:3.0:1784044279.712843:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044279.712845:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598764672 00000100:00080000:3.0:1784044279.712852:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044279.712918:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598764928 00000100:00100000:2.0:1784044279.712923:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598764928 00000100:00100000:3.0:1784044279.712937:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598764544:0@lo:400:kworker.0 00000100:00100000:3.0:1784044279.712965:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bc5aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598765056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044279.712978:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784044279.712985:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598764416:0@lo:400:kworker.0 00000100:00100000:2.0:1784044279.712996:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bc5adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598764800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044279.713042:0:14274:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784044279.713053:0:14274:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1784044279.713097:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bc5adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1870705598764800:12345-0@lo:400:kworker.0 Request processed in 108us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044279.713122:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784044279.713154:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784044279.713162:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598764672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044279.713212:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1870705598764672:12345-0@lo:400:kworker.0 Request processed in 50us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.713218:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044279.713232:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784044279.713239:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598764928:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784044279.713263:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044279.713365:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1870705598764672:0@lo:400:kworker.0 00000100:00100000:0.0:1784044279.713379:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1870705598764800:0@lo:400:kworker.0 00000100:00100000:1.0:1784044279.713697:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598764288 00000100:00100000:1.0:1784044279.713703:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598764288 00000100:00100000:1.0:1784044279.713751:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1784044279.713759:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3289:x1870705598764288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044279.713808:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3289:x1870705598764288:12345-0@lo:400:kworker.0 Request processed in 49us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044279.713815:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784044279.713942:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d72db5ce-ca39-4323-bf26-8b60fe27b493:3289:1870705598764288:0@lo:400:kworker.0 00000100:00100000:3.0:1784044279.714045:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1870705598764928:12345-0@lo:400:kworker.0 Request processed in 812us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.714055:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044279.714103:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1870705598764928:0@lo:400:kworker.0 00000100:00100000:0.0:1784044279.721022:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044279.727474:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583048064 00000100:00100000:3.0:1784044279.727499:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583048064 00000100:00100000:3.0:1784044279.727595:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:3.0:1784044279.727608:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+7:14389:x1870705583048064:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044279.727637:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044279.727678:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb1e expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044279.727848:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1784044279.728052:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551543 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb1e expref: 9 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.728070:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e100) 00010000:00010000:3.0:1784044279.728074:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044279.728099:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb1e expref: 9 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.728117:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fda00, rc 0) 00000100:00100000:3.0:1784044279.728207:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+8:14389:x1870705583048064:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 602us (7194us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1784044279.728216:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:1.0:1784044279.733359:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044279.733776:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583048320 00000100:00100000:0.0:1784044279.733792:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583048320 00000100:00100000:0.0:1784044279.733899:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:0.0:1784044279.733913:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+8:14389:x1870705583048320:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:0.0:1784044279.733968:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044279.733997:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fde00/0x9cc73983a755153c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb17 expref: 8 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.734016:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bc7c1ec00) 00010000:00010000:0.0:1784044279.734027:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044279.734052:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.734078:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.734088:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044279.734318:0:14275:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004acf6005 reply state 00000000c351454d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044279.734328:0:14275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784044279.734342:0:14275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1784044279.734437:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+9:14389:x1870705583048320:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 527us (1092us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784044279.734445:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00010000:00010000:1.0:1784044279.736533:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.736557:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.736592:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.736600:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044279.736607:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.736617:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.736641:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bda59ac00) 00010000:00010000:1.0:1784044279.736645:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1784044279.736651:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044279.736659:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551551 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044279.736828:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044279.737017:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583048576 00000100:00100000:1.0:1784044279.737029:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583048576 00000100:00100000:1.0:1784044279.737137:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:1.0:1784044279.737150:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+8:14389:x1870705583048576:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1784044279.737511:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+9:14389:x1870705583048576:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 362us (688us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1784044279.737520:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:0.0:1784044279.746082:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044279.751321:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583048832 00000100:00100000:2.0:1784044279.751345:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583048832 00000100:00100000:2.0:1784044279.751461:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:2.0:1784044279.751475:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+9:14389:x1870705583048832:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1784044279.751513:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044279.751543:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7551558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb25 expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.751653:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755155f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.751673:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755155f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.751689:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755155f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.751710:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551566 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.751717:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.751745:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044279.751965:0:16404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784044279.752094:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755155f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752104:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755155f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752112:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755155f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752119:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044279.752125:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755155f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752133:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755155f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752148:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e100) 00010000:00010000:2.0:1784044279.752152:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044279.752157:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755155f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752164:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a755155f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752179:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752195:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551566 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752201:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752206:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044279.752210:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752216:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551566 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752223:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff904bd19d5200) 00010000:00010000:2.0:1784044279.752225:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044279.752228:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551566 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752233:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551566 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752283:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7551558 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb25 expref: 11 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752293:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e100) 00010000:00010000:2.0:1784044279.752295:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044279.752299:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7551558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb25 expref: 11 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.752318:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5a00, rc 0) 00000100:00100000:2.0:1784044279.752416:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+10:14389:x1870705583048832:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 943us (6349us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1784044279.752426:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:0.0:1784044279.758239:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044279.758362:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583048960 00000100:00100000:3.0:1784044279.758375:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583048960 00000100:00100000:3.0:1784044279.758465:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:3.0:1784044279.758478:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+10:14389:x1870705583048960:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044279.758511:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044279.758545:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551574 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb2c expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.758662:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.758680:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.758695:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044279.758760:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1784044279.758765:0:14274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044279.758794:0:14274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.758829:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551574 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb2c expref: 12 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.758907:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb2c expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.758918:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bc7c1ef00) 00010000:00010000:3.0:1784044279.758921:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044279.758924:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fca00, rc 0) 00000100:00100000:3.0:1784044279.759013:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+11:14389:x1870705583048960:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 538us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.759021:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:1.0:1784044279.762570:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044279.762674:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583049088 00000100:00100000:2.0:1784044279.762695:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583049088 00000100:00100000:2.0:1784044279.762785:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:2.0:1784044279.762799:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+11:14389:x1870705583049088:12345-192.168.204.50@tcp:37:lfs.0 00000100:00100000:0.0:1784044279.767363:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+11:14389:x1870705583049088:12345-192.168.204.50@tcp:37:lfs.0 Request processed in 4548us (4784us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044279.767390:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:1.0:1784044279.777647:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044279.777759:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583049344 00000100:00100000:3.0:1784044279.777779:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583049344 00000100:00100000:3.0:1784044279.777931:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:3.0:1784044279.777946:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf566cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+11:14389:x1870705583049344:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1784044279.778392:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf566cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+12:14389:x1870705583049344:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 449us (751us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1784044279.778402:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1784044279.883357:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044279.883497:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583049472 00000100:00100000:2.0:1784044279.883516:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583049472 00000100:00100000:2.0:1784044279.883757:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:2.0:1784044279.883772:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+10:14395:x1870705583049472:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1784044279.883803:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044279.883834:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7551582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb33 expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.883993:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551589 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884012:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884026:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884045:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7551590 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884066:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7551590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884075:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7551590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884231:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7551597 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884241:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7551597 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884249:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7551597 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044279.884305:0:16404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784044279.884311:0:16404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044279.884363:0:16404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7551597 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884378:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884386:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551589 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884395:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551589 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884402:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044279.884407:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551589 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884426:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551589 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884442:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e100) 00010000:00010000:2.0:1784044279.884457:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044279.884463:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884471:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5800/0x9cc73983a7551589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884490:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7551590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884496:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7551590 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884502:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7551590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884507:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044279.884510:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7551590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884517:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7551590 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884525:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff904bd19d5200) 00010000:00010000:2.0:1784044279.884528:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044279.884530:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7551590 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884547:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4a00/0x9cc73983a7551590 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884588:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5a00/0x9cc73983a7551582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb33 expref: 12 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.884606:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4600/0x9cc73983a7551597 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb33 expref: 11 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044279.885951:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bc7c1ef00) 00010000:00010000:2.0:1784044279.885956:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784044279.885959:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4600, rc 0) 00000100:00100000:2.0:1784044279.886076:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+11:14395:x1870705583049472:12345-192.168.204.50@tcp:101:bash.0 Request processed in 2303us (2723us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044279.886086:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:1.0:1784044279.892000:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044279.892720:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583049728 00000100:00100000:3.0:1784044279.892739:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583049728 00000100:00100000:3.0:1784044279.892953:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:3.0:1784044279.892970:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+11:14395:x1870705583049728:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1784044279.893001:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044279.893029:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a755159e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb3a expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.893217:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.893251:0:14274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb2c expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.893262:0:14274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.893309:0:14274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb2c expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.893326:0:14274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb2c expref: 11 pid: 14274 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044279.893342:0:14274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14274:1870705598765184:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044279.893463:0:14274:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd8074000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044279.904496:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044279.904622:0:16291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583049856 00000100:00100000:0.0:1784044279.904635:0:16291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583049856 00010000:00010000:0.0:1784044279.904692:0:16291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb2c expref: 12 pid: 14274 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044279.904748:0:16291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1784044279.904761:0:16291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+12:2347:x1870705583049856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044279.904783:0:16291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044279.904809:0:16291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb2c expref: 12 pid: 14274 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.904826:0:16291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb2c expref: 12 pid: 14274 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.904858:0:16291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bc7c1ef00) 00010000:00010000:0.0:1784044279.904897:0:16291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.904909:0:16291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.904918:0:16291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.904943:0:16291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044279.905016:0:16291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+12:2347:x1870705583049856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 257us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044279.905025:0:16291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00010000:00010000:3.0:1784044279.908118:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a755157b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb2c expref: 11 pid: 14274 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044279.908156:0:14274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14274:1870705598765184:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044279.908190:0:14274:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.908202:0:14274:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.908209:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.908253:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.908290:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.908304:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.909395:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.909413:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.909423:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044279.909438:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784044279.909491:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.909500:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.909507:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.909513:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044279.909519:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.909526:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.909554:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bc7c1ef00) 00010000:00010000:3.0:1784044279.909557:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044279.909562:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.909568:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515a5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044279.909583:0:14274:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000781c94cf reply state 000000007192c294 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044279.909594:0:14274:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784044279.911861:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a755159e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb3a expref: 14 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.911919:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb3a expref: 13 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.911931:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044279.911934:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1784044279.911938:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fd400, rc 0) 00000100:00100000:3.0:1784044279.912081:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+14:14395:x1870705583049728:12345-192.168.204.50@tcp:101:bash.0 Request processed in 19114us (20090us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1784044279.912092:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00010000:00010000:0.0:1784044279.918299:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.918325:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.918334:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.918342:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044279.918348:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.918377:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.918400:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff904bc7c1e600) 00010000:00010000:0.0:1784044279.918403:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044279.918408:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044279.918415:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a75515ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044279.926302:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044279.926622:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583049984 00000100:00100000:3.0:1784044279.926636:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583049984 00000100:00100000:3.0:1784044279.926714:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:3.0:1784044279.926728:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+13:14395:x1870705583049984:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1784044279.926781:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044279.926810:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb41 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.926950:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a75515c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.926969:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a75515c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.926982:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a75515c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044279.927038:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784044279.927043:0:14273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044279.927067:0:14273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a75515c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.927079:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a75515c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.927125:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb41 expref: 15 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.927145:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a75515c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb41 expref: 14 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044279.927154:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044279.927158:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044279.927161:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fca00, rc 0) 00000100:00100000:3.0:1784044279.927235:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+14:14395:x1870705583049984:12345-192.168.204.50@tcp:101:bash.0 Request processed in 511us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044279.927244:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:1.0:1784044279.933400:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044279.933624:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583050240 00000100:00100000:3.0:1784044279.933640:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583050240 00000100:00100000:3.0:1784044279.933720:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1784044279.933733:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+14:14395:x1870705583050240:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:3.0:1784044279.934270:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+15:14395:x1870705583050240:12345-192.168.204.50@tcp:35:bash.0 Request processed in 536us (884us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1784044279.934279:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00010000:00010000:1.0:1784044280.030200:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044280.038801:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044280.039521:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583050496 00000100:00100000:0.0:1784044280.039536:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583050496 00000100:00100000:0.0:1784044280.039631:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:0.0:1784044280.039642:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+15:14405:x1870705583050496:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1784044280.039680:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044280.039712:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb48 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044280.039935:0:14275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784044280.040135:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb48 expref: 17 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.040159:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e100) 00010000:00010000:0.0:1784044280.040163:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044280.040169:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb48 expref: 17 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.040215:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7e00, rc 0) 00000100:00100000:0.0:1784044280.040714:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+16:14405:x1870705583050496:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1069us (1927us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1784044280.040724:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:1.0:1784044280.047892:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044280.048364:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583050752 00000100:00100000:3.0:1784044280.048378:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583050752 00000100:00100000:3.0:1784044280.048465:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1784044280.048490:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+16:14405:x1870705583050752:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1784044280.048897:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+17:14405:x1870705583050752:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 388us (1013us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1784044280.048908:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:1.0:1784044280.100000:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044280.100292:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583051008 00000100:00100000:3.0:1784044280.100307:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583051008 00000100:00100000:3.0:1784044280.100396:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:3.0:1784044280.100410:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+17:14408:x1870705583051008:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044280.100458:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044280.100504:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515dd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb4f expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.100673:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a75515e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.100711:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a75515e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.100726:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a75515e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044280.100742:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784044280.100946:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a75515dd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb4f expref: 20 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.100970:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a75515e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb4f expref: 19 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.100979:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044280.100983:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044280.100988:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fda00, rc 0) 00000100:00100000:3.0:1784044280.101356:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+19:14408:x1870705583051008:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 948us (1371us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1784044280.101365:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:1.0:1784044280.107166:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044280.107224:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044280.107344:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583051264 00000100:00100000:0.0:1784044280.107359:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583051264 00000100:00100000:0.0:1784044280.107453:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:0.0:1784044280.107467:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+19:14408:x1870705583051264:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:0.0:1784044280.107569:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.107592:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.107608:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.107645:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.107653:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.107661:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.107669:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044280.107674:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.107751:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.107769:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044280.107773:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044280.107778:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.107785:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044280.107832:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583051136 00000100:00100000:3.0:1784044280.107837:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583051136 00000100:00100000:0.0:1784044280.107899:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+20:14408:x1870705583051264:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 434us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044280.107908:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:3.0:1784044280.107910:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:3.0:1784044280.107917:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+20:2345:x1870705583051136:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044280.107931:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044280.107952:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a75515e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb4f expref: 19 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.107980:0:14259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044280.107983:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044280.108006:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+18:2345:x1870705583051136:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044280.108012:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1784044280.111088:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044280.111176:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583051520 00000100:00100000:3.0:1784044280.111189:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583051520 00000100:00100000:3.0:1784044280.111264:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1784044280.111277:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+18:14408:x1870705583051520:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1784044280.111660:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+19:14408:x1870705583051520:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 375us (575us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1784044280.111669:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1784044280.196821:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044280.196921:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044280.196952:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044280.196976:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044280.197005:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044280.197035:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044280.197077:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583051904 00000100:00100000:1.0:1784044280.197091:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583051904 00000100:00100000:1.0:1784044280.197167:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583052160 00000100:00100000:1.0:1784044280.197171:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583052160 00000100:00100000:1.0:1784044280.197187:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583051776 00000100:00100000:1.0:1784044280.197190:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583051776 00000100:00100000:1.0:1784044280.197203:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583052288 00000100:00100000:1.0:1784044280.197206:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583052288 00000100:00100000:1.0:1784044280.197224:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1784044280.197235:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2347:x1870705583051904:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044280.197341:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2347:x1870705583051904:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 107us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044280.197350:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1784044280.197397:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044280.197404:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2347:x1870705583052160:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044280.197434:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2347:x1870705583052160:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 31us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044280.197452:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044280.197463:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1784044280.197470:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2347:x1870705583051776:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044280.197494:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2347:x1870705583051776:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044280.197500:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1784044280.197510:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1784044280.197516:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2347:x1870705583052288:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044280.197541:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2347:x1870705583052288:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044280.197548:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00080000:1.0:1784044280.197569:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784044280.197574:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044280.197739:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583052032 00000100:00100000:1.0:1784044280.197744:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583052032 00000100:00100000:1.0:1784044280.197786:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1784044280.197794:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+11:2347:x1870705583052032:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044280.197836:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+11:2347:x1870705583052032:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044280.197843:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:2.0:1784044280.198286:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583051648 00000100:00100000:2.0:1784044280.198293:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583051648 00000100:00100000:2.0:1784044280.198330:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:2.0:1784044280.198338:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:2347:x1870705583051648:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044280.198380:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:2347:x1870705583051648:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 43us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044280.198389:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 120 00000040:00080000:3.0:1784044280.478645:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784044280.522290:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044280.522513:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583052544 00000100:00100000:0.0:1784044280.522528:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583052544 00000100:00100000:0.0:1784044280.522658:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1784044280.522672:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+19:14440:x1870705583052544:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1784044280.522708:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044280.522738:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb56 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.522914:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551600 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.522932:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551600 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.522969:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551600 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044280.522985:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784044280.523199:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75515f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb56 expref: 22 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.523220:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551600 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb56 expref: 21 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.523231:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044280.523234:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044280.523238:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7600, rc 0) 00000100:00100000:0.0:1784044280.523385:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+21:14440:x1870705583052544:12345-192.168.204.50@tcp:101:cat.0 Request processed in 716us (1110us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1784044280.523394:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:2.0:1784044280.533014:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044280.533223:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583052800 00000100:00100000:3.0:1784044280.533237:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583052800 00000100:00100000:3.0:1784044280.533312:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1784044280.533326:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+21:14440:x1870705583052800:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1784044280.533907:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+22:14440:x1870705583052800:12345-192.168.204.50@tcp:35:cat.0 Request processed in 581us (906us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1784044280.533919:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:2.0:1784044280.543195:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044280.543910:0:16291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583052928 00000100:00100000:3.0:1784044280.543927:0:16291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583052928 00000100:00100000:3.0:1784044280.544017:0:16291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1784044280.544031:0:16291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0233800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+22:2345:x1870705583052928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044280.544084:0:16291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044280.544125:0:16291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7600/0x9cc73983a7551600 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb56 expref: 22 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.544154:0:16291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044280.544161:0:16291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044280.544244:0:16291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0233800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+21:2345:x1870705583052928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 216us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044280.544253:0:16291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:1.0:1784044280.651606:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044280.651769:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583053184 00000100:00100000:3.0:1784044280.651785:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583053184 00000100:00100000:3.0:1784044280.651908:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:3.0:1784044280.651923:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+21:14446:x1870705583053184:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:3.0:1784044280.651964:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044280.651995:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a755160e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb5d expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.653335:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551615 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.653359:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551615 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.653374:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551615 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044280.653391:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784044280.653947:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a755160e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb5d expref: 24 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.653980:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551615 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb5d expref: 23 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044280.653991:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044280.653994:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044280.653998:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fd000, rc 0) 00000100:00100000:3.0:1784044280.654405:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+23:14446:x1870705583053184:12345-192.168.204.50@tcp:101:dd.0 Request processed in 2483us (2908us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1784044280.654416:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1784044280.659481:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044280.660855:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583053440 00000100:00100000:1.0:1784044280.660887:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583053440 00000100:00100000:0.0:1784044280.661071:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:0.0:1784044280.661085:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+23:14446:x1870705583053440:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:0.0:1784044280.661164:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784044280.661202:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd000/0x9cc73983a7551615 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb5d expref: 23 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.661349:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fca00/0x9cc73983a75515c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb41 expref: 22 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.661365:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044280.661390:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044280.661902:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.661922:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044280.661935:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044280.661996:0:14275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1784044280.662027:0:14275:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7be9a9d reply state 000000009a6ab390 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044280.662038:0:14275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044280.662249:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+24:14446:x1870705583053440:12345-192.168.204.50@tcp:36:dd.0 Request processed in 1165us (2780us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1784044280.662259:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000020:00080000:0.0:1784044280.662266:0:14275:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784044280.665424:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044280.665455:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044280.665464:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044280.665471:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7e00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044280.665477:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044280.665486:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044280.665516:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:1.0:1784044280.665520:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044280.665527:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044280.665535:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a7551623 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044280.825106:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044280.829003:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583053696 00000100:00100000:3.0:1784044280.829079:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583053696 00000100:00100000:3.0:1784044280.829237:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1784044280.829251:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+23:14446:x1870705583053696:12345-192.168.204.50@tcp:35:dd.0 00000100:00100000:3.0:1784044280.829620:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+24:14446:x1870705583053696:12345-192.168.204.50@tcp:35:dd.0 Request processed in 371us (4629us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1784044280.829628:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00010000:00010000:0.0:1784044281.054455:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044281.098670:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044281.099060:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583053824 00000100:00100000:3.0:1784044281.099074:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583053824 00000100:00080000:1.0:1784044281.099253:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044281.100305:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:3.0:1784044281.100328:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+24:14460:x1870705583053824:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:3.0:1784044281.100365:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044281.100397:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a755162a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb64 expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.100712:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7551631 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.100750:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7551631 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.100765:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7551631 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.100786:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7551638 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.100793:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7551638 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.100800:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7551638 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.100973:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a755163f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.100982:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a755163f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.100991:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a755163f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044281.101042:0:16404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784044281.101047:0:16404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784044281.101097:0:16404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a755163f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101111:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a755163f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101136:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7551631 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101143:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7551631 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101150:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7551631 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101156:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd800 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044281.101160:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7551631 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101169:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7551631 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101185:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bc7c1ef00) 00010000:00010000:3.0:1784044281.101188:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044281.101210:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7551631 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101218:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a7551631 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101234:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7551638 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101241:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7551638 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101248:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7551638 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101264:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fc200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:3.0:1784044281.101267:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7551638 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101274:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7551638 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101284:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff904bc7c1e300) 00010000:00010000:3.0:1784044281.101287:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044281.101290:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7551638 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101297:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a7551638 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101341:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a755162a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb64 expref: 26 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101358:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a755163f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb64 expref: 25 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.101366:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044281.101369:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044281.101371:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc800, rc 0) 00000100:00100000:3.0:1784044281.102601:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+25:14460:x1870705583053824:12345-192.168.204.50@tcp:101:stat.0 Request processed in 2272us (3933us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044281.102613:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:1.0:1784044281.198811:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044281.200028:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583054080 00000100:00100000:3.0:1784044281.200065:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583054080 00000100:00100000:3.0:1784044281.200148:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:3.0:1784044281.200160:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+25:14466:x1870705583054080:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:3.0:1784044281.200243:0:14274:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044281.200280:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a755163f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb64 expref: 25 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.200317:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044281.200324:0:14274:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044281.200787:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.200807:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.200820:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784044281.200952:0:14274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1784044281.200985:0:14274:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093d2af44 reply state 00000000bf665dac transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044281.200997:0:14274:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784044281.201160:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+27:14466:x1870705583054080:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 999us (2370us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1784044281.201169:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00000020:00080000:3.0:1784044281.201176:0:14274:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784044281.204675:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.204718:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.204727:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.204747:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fda00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044281.204753:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.204762:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.204785:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:1.0:1784044281.204788:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044281.204794:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.204802:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fda00/0x9cc73983a7551646 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044281.487681:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044281.492743:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583054208 00000100:00100000:0.0:1784044281.492765:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583054208 00000100:00100000:0.0:1784044281.493017:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:0.0:1784044281.493032:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+26:14480:x1870705583054208:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:0.0:1784044281.494268:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044281.494308:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755164d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb6b expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494428:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551654 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494473:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551654 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494487:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551654 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494510:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755165b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494518:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755165b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494525:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755165b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494659:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494668:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494676:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044281.494809:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1784044281.494815:0:14273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044281.494846:0:14273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494883:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494905:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551654 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494913:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551654 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494921:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551654 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494927:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044281.494932:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551654 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494940:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551654 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494956:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bc7c1ef00) 00010000:00010000:0.0:1784044281.494959:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044281.494964:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551654 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494971:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a7551654 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494988:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755165b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.494995:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755165b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.495283:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755165b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.495298:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044281.495302:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755165b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.495308:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755165b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.495317:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff904bda59ad00) 00010000:00010000:0.0:1784044281.495320:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044281.495323:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755165b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.495330:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755165b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.495380:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755164d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb6b expref: 28 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.495397:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb6b expref: 27 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.495406:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044281.495409:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044281.495412:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7200, rc 0) 00000100:00100000:0.0:1784044281.495530:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+27:14480:x1870705583054208:12345-192.168.204.50@tcp:101:stat.0 Request processed in 2500us (7865us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044281.495540:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:2.0:1784044281.657078:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044281.657314:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583054464 00000100:00100000:3.0:1784044281.657329:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583054464 00000100:00100000:3.0:1784044281.657429:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:3.0:1784044281.657461:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+27:14490:x1870705583054464:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1784044281.657493:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044281.657521:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7551669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb72 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044281.657704:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1784044281.657913:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7551669 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb72 expref: 29 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.657932:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e100) 00010000:00010000:3.0:1784044281.657935:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044281.657942:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7551669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb72 expref: 29 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.658081:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc800, rc 0) 00000100:00100000:3.0:1784044281.658332:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+28:14490:x1870705583054464:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 873us (1267us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1784044281.658349:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:1.0:1784044281.671332:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044281.673996:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583054720 00000100:00100000:0.0:1784044281.674042:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583054720 00000100:00100000:0.0:1784044281.674273:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1784044281.674287:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf566c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+28:14490:x1870705583054720:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1784044281.674729:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf566c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+29:14490:x1870705583054720:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 443us (3410us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1784044281.674738:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1784044281.781194:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044281.781590:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583054976 00000100:00100000:3.0:1784044281.781603:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583054976 00000100:00100000:3.0:1784044281.781679:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:3.0:1784044281.781691:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+29:14496:x1870705583054976:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1784044281.781727:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044281.781757:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7551677 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb79 expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.781921:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.781957:0:16404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb3a expref: 30 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.781966:0:16404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb6b expref: 30 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.781975:0:16404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.782020:0:16404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb6b expref: 30 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.782034:0:16404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb6b expref: 30 pid: 14273 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044281.782051:0:16404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16404:1870705598765312:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044281.782181:0:16404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb3a expref: 30 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.782189:0:16404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb3a expref: 30 pid: 14274 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044281.782198:0:16404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16404:1870705598765440:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044281.782224:0:16404:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5fd2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044281.785689:0:16404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16404:1870705598765440:192.168.204.50@tcp:104: 00000100:00100000:3.0:1784044281.791466:0:16404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16404:1870705598765312:192.168.204.50@tcp:104: 00010000:00010000:3.0:1784044281.791554:0:16404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044281.792462:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044281.792510:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044281.792643:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583055104 00000100:00100000:3.0:1784044281.792654:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583055104 00010000:00010000:3.0:1784044281.792709:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb3a expref: 31 pid: 14274 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044281.792759:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583055232 00000100:00100000:3.0:1784044281.792762:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583055232 00010000:00010000:3.0:1784044281.792779:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb6b expref: 32 pid: 14273 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044281.792806:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1784044281.792817:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+32:2347:x1870705583055104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044281.792838:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044281.792847:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb3a expref: 32 pid: 14274 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.792859:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb3a expref: 32 pid: 14274 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.792912:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75515b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb3a expref: 32 pid: 14274 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.792928:0:14259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044281.792934:0:14259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.792961:0:14259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.792969:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044281.793038:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+31:2347:x1870705583055104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 222us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044281.793045:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1784044281.793108:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:3.0:1784044281.793115:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+30:2347:x1870705583055232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044281.793122:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044281.793128:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb6b expref: 30 pid: 14273 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.793138:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb6b expref: 30 pid: 14273 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.793152:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551662 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb6b expref: 30 pid: 14273 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.793162:0:14259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044281.793166:0:14259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.793175:0:14259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.793184:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.793221:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044281.793241:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+29:2347:x1870705583055232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 126us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044281.793247:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00010000:00010000:3.0:1784044281.793396:0:16404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.793404:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044281.793437:0:16404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1784044281.793675:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a7551677 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb79 expref: 30 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.793694:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb79 expref: 29 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.793703:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044281.793706:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044281.793709:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc200, rc 0) 00000100:00100000:3.0:1784044281.793747:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+29:14496:x1870705583054976:12345-192.168.204.50@tcp:101:bash.0 Request processed in 12059us (12566us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1784044281.793755:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:3.0:1784044281.800200:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044281.800346:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583055488 00000100:00100000:0.0:1784044281.800364:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583055488 00000100:00100000:0.0:1784044281.800464:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:0.0:1784044281.800481:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+29:14496:x1870705583055488:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:0.0:1784044281.800947:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.800970:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.800986:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044281.801052:0:14275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1784044281.801079:0:14275:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3907e47 reply state 00000000a66687a6 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044281.801090:0:14275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044281.801220:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+32:14496:x1870705583055488:12345-192.168.204.50@tcp:36:bash.0 Request processed in 739us (1037us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1784044281.801230:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00000020:00080000:0.0:1784044281.801236:0:14275:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784044281.806219:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1784044281.806815:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.806833:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.806842:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.806892:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044281.806898:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.806908:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.806933:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:1.0:1784044281.806937:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044281.806943:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044281.806951:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a755168c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044281.807225:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583055616 00000100:00100000:2.0:1784044281.807240:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583055616 00000100:00100000:2.0:1784044281.807317:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:2.0:1784044281.807328:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+31:14496:x1870705583055616:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1784044281.807377:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044281.807402:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7551693 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb80 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044281.807502:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7551693 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb80 expref: 32 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044281.807520:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7551693 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb80 expref: 32 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044281.807546:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:2.0:1784044281.807550:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044281.807552:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4000, rc 0) 00000100:00100000:2.0:1784044281.807649:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+32:14496:x1870705583055616:12345-192.168.204.50@tcp:101:bash.0 Request processed in 321us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044281.807658:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1784044281.819462:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044281.820363:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583055744 00000100:00100000:0.0:1784044281.820377:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583055744 00000100:00100000:0.0:1784044281.820468:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:0.0:1784044281.820480:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+32:14496:x1870705583055744:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1784044281.820510:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044281.820542:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a755169a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb87 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.820660:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.820682:0:14275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb79 expref: 33 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.820694:0:14275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.820738:0:14275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb79 expref: 33 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.820754:0:14275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb79 expref: 33 pid: 16404 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044281.820770:0:14275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14275:1870705598765568:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044281.821121:0:14275:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5145300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044281.828774:0:14275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14275:1870705598765568:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044281.828828:0:14275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044281.828964:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044281.829055:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583055872 00000100:00100000:3.0:1784044281.829065:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583055872 00010000:00010000:3.0:1784044281.829146:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb79 expref: 34 pid: 16404 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044281.829192:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:3.0:1784044281.829205:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+34:2347:x1870705583055872:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044281.829226:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044281.829235:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb79 expref: 34 pid: 16404 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.829249:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb79 expref: 34 pid: 16404 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.829277:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a755167e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb79 expref: 34 pid: 16404 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.829297:0:14259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:3.0:1784044281.829303:0:14259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.829314:0:14259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.829324:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.829367:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044281.829461:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+33:2347:x1870705583055872:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 258us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044281.829470:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00010000:00010000:0.0:1784044281.830180:0:14275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.830192:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044281.830264:0:14275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784044281.830270:0:14275:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784044281.830297:0:14275:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.830434:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6200/0x9cc73983a755169a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb87 expref: 33 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.830461:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb87 expref: 32 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044281.830469:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:0.0:1784044281.830473:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044281.830475:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7e00, rc 0) 00000100:00100000:0.0:1784044281.830529:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+32:14496:x1870705583055744:12345-192.168.204.50@tcp:101:bash.0 Request processed in 10050us (11096us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044281.830537:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:1.0:1784044281.837936:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044281.838054:0:16291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583056128 00000100:00100000:2.0:1784044281.838099:0:16291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583056128 00000100:00100000:2.0:1784044281.838174:0:16291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:2.0:1784044281.838186:0:16291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+32:14496:x1870705583056128:12345-192.168.204.50@tcp:103:bash.0 00010000:00010000:2.0:1784044281.838209:0:16291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784044281.838246:0:16291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7e00/0x9cc73983a75516a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb87 expref: 32 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044281.838276:0:16291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a7551693 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb80 expref: 31 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044281.838289:0:16291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bc7c1ea00) 00010000:00010000:2.0:1784044281.838306:0:16291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044281.838422:0:16291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+30:14496:x1870705583056128:12345-192.168.204.50@tcp:103:bash.0 Request processed in 238us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044281.838430:0:16291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:3.0:1784044281.841846:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044281.841982:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583056256 00000100:00100000:2.0:1784044281.841996:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583056256 00000100:00100000:2.0:1784044281.842074:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:2.0:1784044281.842094:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+30:14496:x1870705583056256:12345-192.168.204.50@tcp:58:bash.0 00010000:00010000:2.0:1784044281.842285:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044281.842308:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044281.842323:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044281.847823:0:14273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044281.848074:0:14273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1784044281.848683:0:14273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1784044281.848857:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+30:14496:x1870705583056256:12345-192.168.204.50@tcp:58:bash.0 Request processed in 6765us (7018us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044281.850170:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:1.0:1784044281.855995:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044281.856127:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583056384 00000100:00100000:3.0:1784044281.856141:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583056384 00000100:00100000:3.0:1784044281.856592:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:3.0:1784044281.856607:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+30:14496:x1870705583056384:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1784044281.856637:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044281.856668:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a75516af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb8e expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.856746:0:14274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.856759:0:14274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a75516af lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb8e expref: 31 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.856784:0:14274:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.856800:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a75516af lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb8e expref: 31 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.856815:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bd19d5200) 00010000:00010000:3.0:1784044281.856819:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044281.856823:0:14274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a75516af lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb8e expref: 31 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044281.856831:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc200, rc 0) 00000100:00100000:3.0:1784044281.856934:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+31:14496:x1870705583056384:12345-192.168.204.50@tcp:101:bash.0 Request processed in 331us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044281.856961:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00010000:00010000:3.0:1784044282.079512:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784044282.342725:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:0.0:1784044282.342763:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1784044282.342772:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1784044282.342781:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1784044282.342818:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:3.0:1784044282.526554:0:14305:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784044282.526572:0:14305:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044282.526628:0:14305:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784044282.526635:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1784044282.526827:0:14305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14305:1870705598765696:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784044282.527052:0:14305:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd8074000 going to sleep for 11 seconds 00000100:00100000:3.0:1784044282.542603:0:14305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14305:1870705598765696:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784044282.547203:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044282.549039:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583056512 00000100:00100000:0.0:1784044282.549059:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583056512 00000100:00100000:0.0:1784044282.549155:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1784044282.549168:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+10:14497:x1870705583056512:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1784044282.549519:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+10:14497:x1870705583056512:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 Request processed in 351us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044282.549550:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:1.0:1784044282.556545:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044282.557078:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583056640 00000100:00100000:3.0:1784044282.557094:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583056640 00000100:00100000:3.0:1784044282.557179:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:3.0:1784044282.557201:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+10:14497:x1870705583056640:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784044282.557312:0:16404:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784044282.557626:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+10:14497:x1870705583056640:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 437us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044282.557635:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:3.0:1784044282.568737:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.569124:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583056768 00000100:00100000:2.0:1784044282.569139:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583056768 00000100:00100000:2.0:1784044282.569212:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:2.0:1784044282.569223:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+10:14497:x1870705583056768:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784044282.569449:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75516b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.569538:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75516b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.569559:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75516b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.576451:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a75516bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.576476:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a75516bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.576490:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a75516bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.576525:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.576534:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.577972:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044282.578021:0:14275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784044282.578025:0:14275:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044282.578061:0:14275:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578075:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75516b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578082:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75516b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578089:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75516b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578095:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044282.578099:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75516b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578106:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75516b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578119:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59a800) 00010000:00010000:2.0:1784044282.578121:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044282.578126:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75516b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578132:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4000/0x9cc73983a75516b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578160:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a75516bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578166:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a75516bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578172:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a75516bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578176:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044282.578179:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a75516bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.578185:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a75516bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.579363:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff904bd19d5d00) 00010000:00010000:2.0:1784044282.579372:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044282.579380:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a75516bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.579390:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a75516bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.579431:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.579437:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.579444:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.579468:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044282.579473:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.579480:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.579491:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bd19d5200) 00010000:00010000:2.0:1784044282.579493:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044282.579497:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.579502:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a75516c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044282.579633:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+10:14497:x1870705583056768:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 10404us (10906us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044282.579644:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:1.0:1784044282.585523:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.585617:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583057024 00000100:00100000:2.0:1784044282.585634:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583057024 00000100:00100000:2.0:1784044282.585728:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:2.0:1784044282.585740:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+10:14497:x1870705583057024:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044282.585763:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044282.585789:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb95 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.585944:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.585981:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.585995:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044282.586008:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784044282.586219:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.586228:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.586236:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.586242:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044282.586247:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.586254:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.586266:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bd19d5200) 00010000:00010000:2.0:1784044282.586269:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044282.586274:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.586281:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.586323:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516cb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb95 expref: 12 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.586340:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff904bda59a800) 00010000:00010000:2.0:1784044282.586342:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044282.586347:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb95 expref: 12 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.586358:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5600, rc 0) 00000100:00100000:2.0:1784044282.586438:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+11:14497:x1870705583057024:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 700us (932us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1784044282.586447:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:1.0:1784044282.600329:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044282.600539:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583057152 00000100:00100000:3.0:1784044282.600564:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583057152 00000100:00100000:3.0:1784044282.600629:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:3.0:1784044282.600642:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+11:14497:x1870705583057152:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784044282.600729:0:14274:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784044282.601020:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+11:14497:x1870705583057152:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 380us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044282.601145:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1784044282.604222:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.609362:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583057408 00000100:00100000:2.0:1784044282.609379:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583057408 00000100:00100000:3.0:1784044282.610435:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:3.0:1784044282.610449:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+11:14497:x1870705583057408:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044282.610479:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044282.610502:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75516e0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadb9c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784044282.611751:0:14273:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1784044282.611760:0:14273:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1784044282.611814:0:14273:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1784044282.612156:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a75516e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.612171:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a75516e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.612183:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a75516e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.612257:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a75516e0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb9c expref: 14 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.612277:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a75516e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb9c expref: 13 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.612286:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e200) 00010000:00010000:3.0:1784044282.612290:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044282.612300:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fc800, rc 0) 00000100:00100000:3.0:1784044282.612365:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+13:14497:x1870705583057408:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1919us (8155us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1784044282.612374:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:1.0:1784044282.620158:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.620241:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583057664 00000100:00100000:2.0:1784044282.620257:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583057664 00000100:00100000:2.0:1784044282.620330:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:2.0:1784044282.620342:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+13:14497:x1870705583057664:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784044282.620415:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044282.620443:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc800/0x9cc73983a75516e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb9c expref: 13 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.620464:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e200) 00010000:00010000:2.0:1784044282.620476:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044282.620499:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.620514:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.620761:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.620779:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9d8efaa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.620787:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9d8efaa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.620804:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9d8efaa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622273:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622286:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516f5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622293:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622298:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044282.622303:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622310:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622324:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bc7c1ef00) 00010000:00010000:2.0:1784044282.622327:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044282.622330:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622342:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5600/0x9cc73983a75516f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622354:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9d8efaa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622360:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9d8efaa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622366:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9d8efaa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622371:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f4200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044282.622374:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9d8efaa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.622380:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9d8efaa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.623382:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9d8efaa7 (ffff904bd19d5d00) 00010000:00010000:2.0:1784044282.623388:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044282.623401:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9d8efaa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.623409:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a75516fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9d8efaa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044282.627967:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+12:14497:x1870705583057664:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 7613us (7810us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784044282.627979:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:1.0:1784044282.628210:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.628343:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583057792 00000100:00100000:2.0:1784044282.628351:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583057792 00000100:00100000:3.0:1784044282.628475:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:3.0:1784044282.628488:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+12:14497:x1870705583057792:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044282.628509:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044282.628543:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7551703 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadba3 expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.628595:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a755170a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.628611:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a755170a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.628624:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a755170a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.629006:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc000/0x9cc73983a7551703 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadba3 expref: 14 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.629025:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd800/0x9cc73983a755170a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadba3 expref: 13 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.629034:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:3.0:1784044282.629036:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784044282.629040:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fd800, rc 0) 00000100:00100000:3.0:1784044282.629113:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+13:14497:x1870705583057792:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 628us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044282.629125:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:1.0:1784044282.634227:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044282.634303:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583058048 00000100:00100000:3.0:1784044282.634313:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583058048 00000100:00100000:3.0:1784044282.634376:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:3.0:1784044282.634386:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+13:14497:x1870705583058048:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784044282.634483:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.634503:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.634516:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044282.635149:0:14274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1784044282.635160:0:14274:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 460620295252ns, next at 461620293094ns, rc = 0 00000004:00010000:3.0:1784044282.635246:0:14274:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f8d0c20 reply state 000000003f048654 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044282.635257:0:14274:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784044282.635353:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+15:14497:x1870705583058048:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 967us (1134us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1784044282.635361:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00010000:00010000:0.0:1784044282.637471:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.637487:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.637496:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.637502:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044282.637508:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.637516:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.637535:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:0.0:1784044282.637539:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784044282.637544:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.637565:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd400/0x9cc73983a7551711 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044282.642660:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.642831:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583058176 00000100:00100000:2.0:1784044282.642842:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583058176 00000100:00100000:2.0:1784044282.642940:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:2.0:1784044282.642951:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+14:14497:x1870705583058176:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044282.642976:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044282.642999:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7551718 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadbaa expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.643059:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7551718 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbaa expref: 15 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.643075:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7551718 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbaa expref: 15 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.643095:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:2.0:1784044282.643099:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044282.643102:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f4200, rc 0) 00000100:00100000:2.0:1784044282.643164:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+15:14497:x1870705583058176:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 215us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044282.643172:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:1.0:1784044282.646374:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.648201:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583058304 00000100:00100000:2.0:1784044282.648222:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583058304 00000100:00100000:2.0:1784044282.648376:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:2.0:1784044282.648390:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2347:x1870705583058304:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784044282.649125:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:2347:x1870705583058304:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 735us (2757us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1784044282.649150:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00080000:1.0:1784044282.652663:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044282.652845:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044282.652980:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583058560 00000100:00100000:3.0:1784044282.652990:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583058560 00000100:00100000:3.0:1784044282.653090:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1784044282.653101:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+15:14497:x1870705583058560:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784044282.653366:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+16:14497:x1870705583058560:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 266us (525us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1784044282.653391:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1784044282.656017:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044282.656204:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583058816 00000100:00100000:0.0:1784044282.656215:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583058816 00000100:00100000:0.0:1784044282.656281:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:0.0:1784044282.656292:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+16:14497:x1870705583058816:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784044282.656495:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+16:14497:x1870705583058816:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 204us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044282.656504:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:3.0:1784044282.660148:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.660249:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583058944 00000100:00100000:2.0:1784044282.660260:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583058944 00000100:00100000:2.0:1784044282.660324:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:2.0:1784044282.660708:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+16:14497:x1870705583058944:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044282.660731:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044282.660757:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a755171f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadbb1 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.661420:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551726 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.661510:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.661532:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044282.661576:0:14275:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784044282.662189:0:14275:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.662242:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a755171f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb1 expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.662268:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551726 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb1 expref: 17 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.662280:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:2.0:1784044282.662302:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784044282.662306:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc81f5200, rc 0) 00000100:00100000:2.0:1784044282.662801:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+17:14497:x1870705583058944:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 2096us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044282.662812:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:1.0:1784044282.667924:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044282.667993:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583059072 00000100:00100000:3.0:1784044282.668002:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583059072 00000100:00100000:3.0:1784044282.668061:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:3.0:1784044282.668070:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+6:2347:x1870705583059072:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044282.668088:0:14909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044282.668110:0:14909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755172d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadbb8 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044282.668140:0:14909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565afa, blocks: 0x1 00010000:00010000:3.0:1784044282.668160:0:14909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1784044282.668164:0:14909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044282.668173:0:14909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755172d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb8 expref: 7 pid: 14909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.668192:0:14909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755172d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb8 expref: 7 pid: 14909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.668205:0:14909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beb0fda00, rc 0) 00000100:00100000:3.0:1784044282.668370:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:2347:x1870705583059072:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 299us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044282.668378:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1784044282.673350:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044282.673447:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583059328 00000100:00100000:3.0:1784044282.673466:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583059328 00000100:00100000:3.0:1784044282.673543:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:3.0:1784044282.673561:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+17:14497:x1870705583059328:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784044282.673663:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+17:14497:x1870705583059328:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044282.673940:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:3.0:1784044282.677854:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044282.677987:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583059456 00000100:00100000:0.0:1784044282.677998:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583059456 00000100:00100000:0.0:1784044282.678108:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:0.0:1784044282.678119:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+17:14497:x1870705583059456:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784044282.705848:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:2.0:1784044282.705882:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1784044282.705889:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1784044282.706051:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044282.706069:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bf5ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598765824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784044282.706132:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044282.706184:0:16258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598765824 00000100:00100000:0.0:1784044282.706191:0:16258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598765824 00000100:00100000:0.0:1784044282.706238:0:16258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044282.706246:0:16258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1870705598765824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1784044282.706403:0:16258:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784044282.706407:0:16258:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1784044282.706409:0:16258:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784044282.706412:0:16258:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784044282 -> 1784044282 00002000:00010000:0.0:1784044282.706414:0:16258:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784044282.706465:0:16258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1870705598765824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (320us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1784044282.706473:0:16258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1784044282.706522:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff904bf5ba2a00/2, rc 0, transno 8589934595 00000100:00100000:0.0:1784044282.706528:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bf5ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1870705598765824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784044282.706918:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+13:14497:x1870705583059456:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 28798us (29075us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044282.706928:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00080000:1.0:1784044282.706951:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044282.709735:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.710040:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583059584 00000100:00100000:2.0:1784044282.710051:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583059584 00000100:00100000:0.0:1784044282.710227:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:0.0:1784044282.710237:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:2348:x1870705583059584:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784044282.710367:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:2348:x1870705583059584:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 126us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044282.710375:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1784044282.712828:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.713016:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583059840 00000100:00100000:2.0:1784044282.713027:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583059840 00000100:00100000:2.0:1784044282.713094:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:2.0:1784044282.713105:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+13:14497:x1870705583059840:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784044282.713164:0:16404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044282.713193:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551726 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb1 expref: 13 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.713213:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:2.0:1784044282.713219:0:16404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044282.713249:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.713262:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.713272:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044282.713559:0:16404:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008fedbbaf reply state 000000007077845a transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044282.713577:0:16404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044282.713687:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+14:14497:x1870705583059840:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 583us (868us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1784044282.713694:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:1.0:1784044282.716560:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1784044282.716646:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.716660:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.716668:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.716687:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:2.0:1784044282.716692:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.716699:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.716716:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:2.0:1784044282.716719:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044282.716724:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.716730:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551734 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044282.717825:0:16258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583059968 00000100:00100000:0.0:1784044282.717838:0:16258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583059968 00000100:00100000:0.0:1784044282.721054:0:16258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1784044282.721076:0:16258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:14497:x1870705583059968:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044282.721096:0:16258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044282.721118:0:16258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadbbf expref: -99 pid: 16258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.721155:0:16258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755172d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb8 expref: 8 pid: 14909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.721165:0:16258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044282.721170:0:16258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044282.721176:0:16258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 8 pid: 16258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.721214:0:16258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755172d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb8 expref: 8 pid: 14909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.721228:0:16258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755172d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb8 expref: 8 pid: 14909 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044282.721266:0:16258:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16258:1870705598765952:192.168.204.50@tcp:104: 00000100:00100000:0.0:1784044282.721379:0:16258:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc24643c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044282.727044:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044282.727886:0:16258:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16258:1870705598765952:192.168.204.50@tcp:104: 00010000:00010000:0.0:1784044282.727929:0:16258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 8 pid: 16258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.727951:0:16258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904beeee7600, rc 0) 00000100:00100000:0.0:1784044282.728008:0:16258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+8:14497:x1870705583059968:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 6942us (11464us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044282.728018:0:16258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1784044282.729331:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583060096 00000100:00100000:3.0:1784044282.729346:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583060096 00010000:00010000:2.0:1784044282.729781:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755172d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb8 expref: 8 pid: 14909 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044282.729909:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:2.0:1784044282.729921:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+8:2348:x1870705583060096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044282.729938:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044282.729963:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755172d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb8 expref: 8 pid: 14909 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.729976:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755172d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb8 expref: 8 pid: 14909 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.730000:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ccc9303/0x9cc73983a755172d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbb8 expref: 8 pid: 14909 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.730015:0:14259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044282.730020:0:14259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044282.730028:0:14259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 7 pid: 16258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.730039:0:14259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 7 pid: 16258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.730076:0:14259:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 7 pid: 16258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044282.730103:0:14259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14259:1870705598766080:192.168.204.50@tcp:105: 00000100:00100000:2.0:1784044282.730193:0:14259:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044282.733324:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044282.733421:0:14909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583060224 00000100:00100000:0.0:1784044282.733430:0:14909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583060224 00000100:00100000:0.0:1784044282.733491:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:0.0:1784044282.733500:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+8:2347:x1870705583060224:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784044282.733798:0:14909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784044282.733802:0:14909:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1784044282 00002000:00010000:0.0:1784044282.733804:0:14909:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1784044280 00002000:00010000:0.0:1784044282.733806:0:14909:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784044282 -> 1784044282 00002000:00010000:0.0:1784044282.733809:0:14909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784044282.733919:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:2347:x1870705583060224:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 419us (603us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784044282.733927:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1784044282.734173:0:14259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14259:1870705598766080:192.168.204.50@tcp:105: 00010000:00010000:2.0:1784044282.734196:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044282.734216:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+8:2348:x1870705583060096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4299us (7185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044282.734224:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1784044282.737069:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.737175:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583060352 00000100:00100000:2.0:1784044282.737185:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583060352 00000100:00100000:2.0:1784044282.737245:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:2.0:1784044282.737255:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+8:2348:x1870705583060352:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784044282.737298:0:14910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.737318:0:14910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 8 pid: 16258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.737327:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044282.737332:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044282.737336:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.737371:0:14910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 8 pid: 16258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.737410:0:14910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 8 pid: 16258 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044282.737427:0:14910:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14910:1870705598766208:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044282.737518:0:14910:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044282.740808:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044282.740898:0:16291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583060480 00000100:00100000:3.0:1784044282.740907:0:16291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583060480 00010000:00010000:3.0:1784044282.740942:0:16291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 9 pid: 16258 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044282.740985:0:16291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:3.0:1784044282.740994:0:16291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:2347:x1870705583060480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044282.741008:0:16291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044282.741028:0:16291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 9 pid: 16258 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.741042:0:16291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 9 pid: 16258 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.741065:0:16291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044282.741069:0:16291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044282.741075:0:16291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.741102:0:16291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.741122:0:16291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044282.741167:0:16291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+9:2347:x1870705583060480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 174us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044282.741174:0:16291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00010000:00010000:2.0:1784044282.742017:0:14910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cdab3b/0x9cc73983a755173b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbbf expref: 8 pid: 16258 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044282.742039:0:14910:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14910:1870705598766208:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044282.742061:0:14910:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.742072:0:14910:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.742079:0:14910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.742109:0:14910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.742118:0:14910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.742142:0:14910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.742150:0:14910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5400 already unused, calling callback (ffffffffc1549230) 00010000:00010000:2.0:1784044282.742155:0:14910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.742165:0:14910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.742180:0:14910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.742188:0:14910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007530f0cb/0x9cc73983a7551742 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044282.742302:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:2348:x1870705583060352:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 5048us (5242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044282.742312:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:1.0:1784044282.748584:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.748774:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583060736 00000100:00100000:2.0:1784044282.748785:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583060736 00000100:00100000:2.0:1784044282.748845:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:2.0:1784044282.748855:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+13:14497:x1870705583060736:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784044282.748968:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551749 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.749001:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.749015:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.749254:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.749266:0:14275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7551718 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbaa expref: 14 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.749274:0:14275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.749308:0:14275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7551718 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbaa expref: 14 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044282.749321:0:14275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7551718 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbaa expref: 14 pid: 14275 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044282.749334:0:14275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14275:1870705598766336:192.168.204.50@tcp:104: 00000100:00100000:2.0:1784044282.749431:0:14275:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc5077e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044282.753190:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1784044282.753322:0:14275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bd0233b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14275:1870705598766336:192.168.204.50@tcp:104: 00010000:00010000:2.0:1784044282.753350:0:14275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044282.753439:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583060864 00000100:00100000:3.0:1784044282.753447:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583060864 00010000:00010000:3.0:1784044282.753563:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7551718 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbaa expref: 15 pid: 14275 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044282.753603:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1784044282.753612:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+15:2348:x1870705583060864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044282.753627:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044282.753634:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7551718 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbaa expref: 15 pid: 14275 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.753647:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7551718 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbaa expref: 15 pid: 14275 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.753741:0:14258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f4200/0x9cc73983a7551718 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbaa expref: 15 pid: 14275 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.753761:0:14258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:3.0:1784044282.753784:0:14258:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.753794:0:14258:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.753802:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.753957:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044282.754012:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+14:2348:x1870705583060864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 399us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044282.754020:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00010000:00010000:0.0:1784044282.755778:0:14275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.755794:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044282.756050:0:14275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1784044282.756215:0:14275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1784044282.756264:0:14275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1784044282.756367:0:14275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14275:1870705598766464:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784044282.756751:0:14275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044282.756909:0:14275:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bc7c53e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044282.757059:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598766464 00000100:00100000:2.0:1784044282.757081:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598766464 00000100:00100000:2.0:1784044282.757165:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044282.757176:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14275:x1870705598766464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784044282.757272:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14275:x1870705598766464:12345-0@lo:1000:mdt00_002.0 Request processed in 99us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044282.757280:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044282.757352:0:14275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14275:1870705598766464:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1784044282.758118:0:14275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1784044282.758200:0:14275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14275:1870705598766592:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784044282.758249:0:14275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044282.759162:0:14275:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd8074300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044282.759243:0:14279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598766592 00000100:00100000:0.0:1784044282.759252:0:14279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598766592 00000100:00100000:0.0:1784044282.759294:0:14279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044282.759302:0:14279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14275:x1870705598766592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784044282.760126:0:14279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14275:x1870705598766592:12345-0@lo:1000:mdt00_002.0 Request processed in 821us (1873us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1784044282.760136:0:14279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044282.760279:0:14275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14275:1870705598766592:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1784044282.760319:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760330:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760338:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760359:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044282.760363:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760371:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760389:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:1.0:1784044282.760403:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044282.760408:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760415:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5200/0x9cc73983a7551750 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760451:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760528:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760537:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760542:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5c00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044282.760545:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760617:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760638:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bd19d5200) 00010000:00010000:1.0:1784044282.760641:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044282.760648:0:14275:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a75516af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb8e expref: 17 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760660:0:14275:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a75516af lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb8e expref: 17 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760739:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a75516af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb8e expref: 17 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.760784:0:14275:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fc200/0x9cc73983a75516af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadb8e expref: 17 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044282.760799:0:14275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffca9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14275:1870705598766720:192.168.204.50@tcp:105: 00000100:00100000:1.0:1784044282.761030:0:14275:0:(client.c:2702:ptlrpc_set_wait()) set ffff904bd8074300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044282.764411:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044282.765081:0:14275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffca9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14275:1870705598766720:192.168.204.50@tcp:105: 00010000:00010000:1.0:1784044282.765111:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765123:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5c00/0x9cc73983a75516a8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765159:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a7551757 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765174:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a7551757 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765200:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a7551757 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765210:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a7551757 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765216:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a7551757 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765222:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a7551757 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765228:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc1662000 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044282.765232:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a7551757 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765239:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a7551757 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765250:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bd19d5200) 00010000:00010000:1.0:1784044282.765253:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044282.765257:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a7551757 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765262:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662000/0x9cc73983a7551757 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765272:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765277:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551749 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765288:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551749 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765293:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904bc81f5400 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:1.0:1784044282.765296:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551749 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765302:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551749 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765311:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bd19d5200) 00010000:00010000:1.0:1784044282.765313:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784044282.765316:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551749 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.765321:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc81f5400/0x9cc73983a7551749 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044282.765662:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583060992 00000100:00100000:0.0:1784044282.765743:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583060992 00000100:00100000:0.0:1784044282.765854:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:0.0:1784044282.765880:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+18:14496:x1870705583060992:12345-192.168.204.50@tcp:49:bash.0 00000100:00100000:0.0:1784044282.766027:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+18:14496:x1870705583060992:12345-192.168.204.50@tcp:49:bash.0 Request processed in 162us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044282.766036:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000040:00080000:1.0:1784044282.766283:0:14305:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784044282.766288:0:14305:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044282.766317:0:14305:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1784044282.766323:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1784044282.766400:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+17:14497:x1870705583060736:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 17536us (17815us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1784044282.766409:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000020:00080000:1.0:1784044282.766414:0:14275:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1784044282.769306:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044282.771272:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044282.771309:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583061376 00000100:00100000:1.0:1784044282.771332:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583061376 00000100:00100000:1.0:1784044282.771386:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1784044282.771409:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+7:14496:x1870705583061376:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1784044282.771428:0:14911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044282.771456:0:14911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020284f79/0x9cc73983a755175e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadbc6 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784044282.771482:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a565afa, atime: 0x6a565af8, ctime: 0x6a565afa, blocks: 0x1 00010000:00010000:1.0:1784044282.771506:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1784044282.771511:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044282.771522:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020284f79/0x9cc73983a755175e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbc6 expref: 8 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.771557:0:14911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020284f79/0x9cc73983a755175e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbc6 expref: 8 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.771571:0:14911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1663600, rc 0) 00000100:00100000:1.0:1784044282.771639:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+8:14496:x1870705583061376:12345-192.168.204.50@tcp:101:bash.0 Request processed in 232us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044282.771646:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:3.0:1784044282.774210:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583061248 00000100:00100000:3.0:1784044282.774227:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583061248 00000100:00100000:3.0:1784044282.774295:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:3.0:1784044282.774306:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+17:14497:x1870705583061248:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784044282.775291:0:14277:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784044282.775411:0:14277:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1784044282.775465:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.775483:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.775495:0:14277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.775505:0:14277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.775519:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.775526:0:14277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044282.776329:0:14277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784044282.776462:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+19:14497:x1870705583061248:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 2146us (7153us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1784044282.776473:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000020:00080000:3.0:1784044282.776479:0:14277:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784044282.779435:0:15895:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044282.779458:0:15895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.779471:0:15895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beb0fd600 already unused, calling callback (ffffffffc1549230) 00010000:00010000:1.0:1784044282.779475:0:15895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.779504:0:15895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.779523:0:15895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff904bc7c1e300) 00010000:00010000:1.0:1784044282.779526:0:15895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784044282.779531:0:15895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.779791:0:15895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beb0fd600/0x9cc73983a7551765 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.779807:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044282.779809:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044282.779811:0:15895:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044282.780590:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044282.781574:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583061632 00000100:00100000:3.0:1784044282.781589:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583061632 00000100:00100000:3.0:1784044282.781663:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:3.0:1784044282.781909:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+19:14496:x1870705583061632:12345-192.168.204.50@tcp:35:bash.0 00000001:00080000:3.0:1784044282.782173:0:14277:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1784044282.782278:0:14277:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1784044282.782387:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+22:14496:x1870705583061632:12345-192.168.204.50@tcp:35:bash.0 Request processed in 714us (1801us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1784044282.782405:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000020:00080000:3.0:1784044282.782410:0:14277:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1784044282.885636:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044282.885830:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583061888 00000100:00100000:1.0:1784044282.885842:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583061888 00000100:00100000:1.0:1784044282.885940:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1784044282.885952:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bd0233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+22:14507:x1870705583061888:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1784044282.885979:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044282.886002:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755176c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe1e80b6b1eadbcd expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044282.886271:0:16404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1784044282.886454:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755176c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbcd expref: 24 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.886469:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff904bc7c1e100) 00010000:00010000:1.0:1784044282.886479:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044282.886484:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904bc1662e00/0x9cc73983a755176c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xfe1e80b6b1eadbcd expref: 24 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044282.886498:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff904bc1662e00, rc 0) 00000100:00100000:1.0:1784044282.886799:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bd0233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+23:14507:x1870705583061888:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 848us (1171us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1784044282.886807:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1784044282.894330:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1784044282.894400:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583062016 00000100:00100000:0.0:1784044282.894412:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583062016 00000100:00100000:0.0:1784044282.894774:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1784044282.894786:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+23:14507:x1870705583062016:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1784044282.894861:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755177a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.894956:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755177a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.894968:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755177a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.894985:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7551781 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.894991:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7551781 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.894997:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7551781 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895297:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895306:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895314:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044282.895354:0:14273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895368:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755177a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895382:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755177a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895399:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755177a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895406:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6a00 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044282.895411:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755177a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895418:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755177a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895431:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff904bc7c1ef00) 00010000:00010000:0.0:1784044282.895434:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044282.895439:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755177a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895445:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6a00/0x9cc73983a755177a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.895527:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7551781 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896195:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7551781 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896206:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7551781 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896211:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee6600 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044282.896223:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7551781 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896230:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7551781 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896240:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff904bda59ad00) 00010000:00010000:0.0:1784044282.896243:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044282.896246:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7551781 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896252:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee6600/0x9cc73983a7551781 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896273:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896278:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896283:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896288:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff904beeee7200 already unused, calling callback (ffffffffc1f524f0) 00010000:00010000:0.0:1784044282.896290:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896296:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896303:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff904bd19d5200) 00010000:00010000:0.0:1784044282.896305:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044282.896314:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044282.896321:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff904beeee7200/0x9cc73983a7551788 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044282.896427:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+23:14507:x1870705583062016:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1640us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044282.896436:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1784044282.899052:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044282.899145:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583062272 00000100:00100000:1.0:1784044282.899154:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583062272 00000100:00100000:1.0:1784044282.899259:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1784044282.899269:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bfb5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+23:14507:x1870705583062272:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1784044282.900276:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bfb5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+24:14507:x1870705583062272:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 1001us (1225us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1784044282.900288:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00010000:00010000:1.0:1784044283.102006:0:15896:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044283.807150:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044283.807177:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bffac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598766848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044283.807251:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044283.807316:0:15893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598766848 00000100:00100000:3.0:1784044283.807324:0:15893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598766848 00000100:00100000:3.0:1784044283.807387:0:15893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784044283.807396:0:15893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598766848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044283.807455:0:15893:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784044283.807502:0:15893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598766848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044283.807509:0:15893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784044283.807559:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bffac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598766848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784044284.128683:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784044284.170305:0:16444:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1784044284.830699:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598766976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044284.830774:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044284.830969:0:14913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598766976 00000100:00100000:0.0:1784044284.830978:0:14913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598766976 00000100:00100000:0.0:1784044284.831044:0:14913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784044284.831055:0:14913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598766976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044284.831093:0:14913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784044284.831144:0:14913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bffac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1870705598766976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044284.831151:0:14913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784044284.831197:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1870705598766976:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784044284.831268:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1784044284.837291:0:14305:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784044284.837304:0:14305:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044284.837343:0:14305:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1784044284.837349:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1784044284.837693:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598767232:0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.837766:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044284.837818:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044284.837825:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598767360:0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.837857:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044284.837947:0:16258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598767232 00000100:00100000:0.0:1784044284.837955:0:16258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598767232 00000100:00100000:0.0:1784044284.838007:0:16258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044284.838016:0:16258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598767232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838067:0:16258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3288:x1870705598767232:12345-0@lo:400:kworker.0 Request processed in 52us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044284.838075:0:16258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044284.838096:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598767360 00000100:00100000:0.0:1784044284.838099:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598767360 00000100:00100000:0.0:1784044284.838126:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784044284.838133:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598767360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838166:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870705598767360:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044284.838172:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1784044284.838190:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044284.838206:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904bfb5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d72db5ce-ca39-4323-bf26-8b60fe27b493:3291:1870705598767104:0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838237:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044284.838260:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598767616:0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838285:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044284.838304:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044284.838310:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff904beb0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598767488:0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838332:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044284.838370:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598767104 00000100:00100000:0.0:1784044284.838374:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598767104 00000100:00100000:0.0:1784044284.838399:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784044284.838406:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3291:x1870705598767104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838443:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d72db5ce-ca39-4323-bf26-8b60fe27b493+19:3291:x1870705598767104:12345-0@lo:400:kworker.0 Request processed in 37us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044284.838457:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784044284.838486:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598767616 00000100:00100000:0.0:1784044284.838490:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598767616 00000100:00100000:0.0:1784044284.838514:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705598767488 00000100:00100000:0.0:1784044284.838517:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705598767488 00000100:00100000:0.0:1784044284.838536:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044284.838542:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598767616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838573:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1870705598767616:12345-0@lo:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044284.838580:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044284.838592:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784044284.838598:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904beb0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598767488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838640:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904beb0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1870705598767488:12345-0@lo:400:kworker.0 Request processed in 42us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044284.838647:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1784044284.838667:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044284.838725:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1870705598767488:0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838735:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904bfb5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d72db5ce-ca39-4323-bf26-8b60fe27b493:3291:1870705598767104:0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838744:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1870705598767616:0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838778:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870705598767360:0@lo:400:kworker.0 00000100:00100000:0.0:1784044284.838788:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff904beb0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1870705598767232:0@lo:400:kworker.0 00010000:00010000:2.0:1784044285.151022:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044285.308577:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044285.308737:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044285.308783:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044285.308818:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044285.308839:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1784044285.308857:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044285.308920:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583062656 00000100:00100000:1.0:1784044285.308927:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1784044285.308932:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583062656 00000100:00100000:1.0:1784044285.308955:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583062912 00000100:00100000:1.0:1784044285.308961:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583062912 00000100:00100000:3.0:1784044285.308990:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583063168 00000100:00100000:3.0:1784044285.308995:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583063168 00000100:00100000:1.0:1784044285.309015:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583062528 00000100:00100000:3.0:1784044285.309016:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583062784 00000100:00100000:1.0:1784044285.309021:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583062528 00000100:00100000:3.0:1784044285.309022:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583062784 00000100:00100000:3.0:1784044285.309037:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583063040 00000100:00100000:3.0:1784044285.309040:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583063040 00000100:00100000:1.0:1784044285.309072:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:3.0:1784044285.309073:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1784044285.309089:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:2348:x1870705583062912:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044285.309090:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+8:2348:x1870705583062656:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044285.309166:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+6:2348:x1870705583062912:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 83us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044285.309174:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:1.0:1784044285.309190:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:1.0:1784044285.309197:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+24:2348:x1870705583062528:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1784044285.309598:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705583062400 00000100:00100000:2.0:1784044285.309605:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705583062400 00000100:00100000:2.0:1784044285.309731:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:2.0:1784044285.309798:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf58ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:2348:x1870705583062400:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044285.311734:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+24:2348:x1870705583062528:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2523us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044285.311758:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:1.0:1784044285.311830:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1784044285.311843:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2348:x1870705583063168:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044285.311921:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2348:x1870705583063168:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 83us (3101us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044285.311929:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1784044285.311938:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+8:2348:x1870705583062656:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2850us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044285.311948:0:14909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1784044285.311957:0:14909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2348:x1870705583062784:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1784044285.311986:0:14909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2688e73-1cb4-4d8a-8c75-d614a6f1c88e+5:2348:x1870705583062784:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 30us (3127us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044285.312239:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf58ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1af28ca4-f7e6-4d46-a470-327c29aa2a2b+13:2348:x1870705583062400:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2498us (3671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044285.312249:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:2.0:1784044285.312289:0:14910:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1784044285.312298:0:14910:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1784044285.312747:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:3.0:1784044285.312769:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:3.0:1784044285.312781:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff904bf56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2348:x1870705583063040:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1784044285.312815:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff904bf56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aafb399-b9e5-4cb5-87ad-2f2c2acb2ab9+5:2348:x1870705583063040:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 39us (3890us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044285.312830:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00080000:3.0:1784044285.312847:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044285.312853:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044285.312855:0:14268:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044285.313159:0:14909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 Debug log: 29455 lines, 29455 kept, 0 dropped, 0 bad.